About us

Trideca is a strategy, data and digital partner for technology transformation across Australia. We have worked with some of Australia's leading enterprise companies (including NAB, Suncorp, Optus, Medibank, AGL and many more), to help transform and empower their businesses.

Working for Trideca, you will be challenged to think outside the box and do things you have not done before. We tackle unique challenges and work on innovative projects for our enterprise clients across various sectors. As part of the Trideca team, you will be able to embrace opportunities for growth with emerging technologies, in a fast-paced, collaborative, and rapidly growing environment across Melbourne, Sydney and Brisbane.

At Trideca, we cut through red tape to get things done efficiently. Join us for a dynamic career where you can make a real impact. You can learn more about us here: https://www.trideca.com.au/

About the role

The Artificial Intelligence (AI) Testing Specialist is responsible for ensuring the accuracy, reliability, and fairness of AI systems and applications through rigorous testing and evaluation. This role focuses on designing and executing test plans, identifying potential flaws, mitigating risks, and validating that AI models meet business objectives and ethical standards. The AI Testing Specialist collaborates with data scientists, developers, and business stakeholders to establish robust quality assurance processes tailored to the unique challenges of AI systems.

Key Responsibilities

Test Strategy and Planning

• Develop comprehensive testing strategies and methodologies for AI systems, including machine learning models, NLP systems, and computer vision applications.
• Create detailed test plans and cases, covering functionality, performance, scalability, security, and ethical considerations.
• Collaborate with stakeholders to define success criteria and testing requirements for AI-driven solutions.

Model Validation and Verification

• Evaluate AI models for accuracy, reliability, and bias across diverse datasets and scenarios.
• Conduct exploratory testing to identify edge cases, inconsistencies, and unexpected behaviors.
• Validate model outputs against ground truth data or expected results to ensure performance meets requirements.

Bias and Fairness Testing

• Assess AI models for potential biases in data, algorithms, and outputs.
• Perform fairness testing to ensure models do not discriminate against specific user groups or populations.
• Propose strategies to mitigate bias and promote ethical AI practices.

Performance and Scalability Testing

• Test AI systems for performance under various loads and conditions to ensure scalability and responsiveness.
• Identify bottlenecks, optimize algorithms, and provide recommendations to improve system efficiency.
• Monitor real-time AI system behavior to ensure stability in production environments.

Automation and Tool Development

• Develop and implement automated testing frameworks for AI models, leveraging tools and frameworks like TensorFlow Test, PyTest, or MLFlow.
• Create scripts for testing model reproducibility, accuracy, and versioning.
• Continuously improve testing processes by integrating new tools and techniques.

Collaboration and Reporting

• Work closely with data scientists and developers to understand model architecture, data pipelines, and deployment workflows.
• Document test results, bugs, and recommendations, ensuring stakeholders have clear visibility into system quality.
• Provide actionable feedback to improve AI system design, training, and deployment processes.

Research and Innovation

• Stay updated on advancements in AI testing methodologies, tools, and best practices.
• Experiment with new testing techniques, such as adversarial testing and explainability testing.
• Contribute to the development of testing standards and frameworks for AI applications within the organization.

Essential requirements

• Bachelors or Masters degree in Computer Science, Data Science, Artificial Intelligence, or a related field.
• 3+ years of experience in software testing, quality assurance, or a related field, with at least 1-2 years focused on AI systems.
• Experience with machine learning lifecycle and AI-specific testing challenges.
• Proficiency in programming languages such as Python or Java, with experience in testing frameworks (e.g., PyTest, Unittest).
• Strong understanding of machine learning concepts, including training, validation, and deployment.
• Familiarity with testing AI tools and libraries (e.g., MLFlow, TensorFlow Test, or Explainability libraries).
• Knowledge of data preprocessing, dataset balancing, and testing for biases and fairness.
• Experience with performance testing tools and techniques.
• Familiarity with CI/CD pipelines and version control tools like Git.

Key Attributes

• Strong analytical and problem-solving skills to identify issues and recommend solutions.
• Attention to detail and a commitment to ensuring high-quality deliverables.
• Excellent communication skills to articulate testing results and collaborate with cross-functional teams.
• A proactive mindset and eagerness to explore innovative testing approaches for AI systems.

Join Trideca: Where Innovation Meets Inclusivity

At Trideca, we're not just building cutting-edge solutions, we're cultivating a workplace that champions diversity, inclusivity, and continuous growth. We believe in creating an environment where every team member feels supported, valued, and empowered to not only operate at their best, but to exceed their own expectations on what they can achieve.

Why Choose Trideca?

Empowering Women in Technology: We are committed to closing the gender gap in technology. With our dedicated road map for women, you'll find tailored opportunities to advance your career, supported by mentorship, leadership programs, Women in Technology Chapter and inclusive policies like menstruation leave and flexible working options.

Growth Through Learning: Your growth is our priority. At Trideca, you'll have access to a wide range of learning and development initiatives, from certifications and workshops to personal development programs, ensuring you are always at the forefront of technology and innovation.

Work Your Way: Our flexible work policy supports you to balance your personal and professional life.

Join a company that not only values innovation but also prioritizes the well-being and development of its people. At Trideca, we're redefining what it means to work in tech.

Ready to make a difference? Apply now and be part of a team that celebrates your unique contributions.

Trideca Values

Clients Come First

We obsess over our clients; they mean everything to us and are central to everything we do. We take the time to understand them, so we can deliver outstanding experiences and create moments of WOW.

We Celebrate Our Differences

We are stronger and more successful when we include and appreciate different backgrounds, ideas, and experiences. Diversity helps us be more creative, solve problems better, and achieve more. By valuing everyone's unique contributions, we create a cohesive workplace where everyone can thrive and grow.

Achieve Greatness Together

Business is a team sport, and we are here to win. We respect, value, and inspire each other to bring our best to raise the bar. We will high-five you when you've nailed it and have honest discussions when you don't.

Own Your Space​

We own our space, relationships, and client outcomes. We are fully committed and accountable to ourselves and each other; we deliver what we commit to. We adopt a commercial outlook and expect everyone to think and make decisions like we are the CEO.

Encourage Open Debate​

We encourage discussion and debate while relentlessly focusing on our overarching vision and purpose in line with our core values; the outcome each and every time is a total commitment to execute what has been decided

Have Fun, Go Nuts

No explanation is required, have fun, go nuts.

We also believe that the unique contributions of everyone at Trideca is the driver of our success. To ensure that our products and culture continue to embrace everyone's perspectives and experiences, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, marital status, veteran status, or disability. We are passionate about creating a workplace that fosters active participation and provides an equal playing field, where merit and accomplishment are the sole criteria for success. We encourage candidates from all backgrounds to apply. We celebrate the diversity of our workforce and are dedicated to creating an environment where everyone feels welcome, valued, and included.