Skip to content
TribalScale

Agentic QA Engineer

Toronto, Ontario, Canada; TorontoCanada
Engineering
POSTED 3 NOVVERIFIED 1H AGO
Apply Ask
Open for
0d
since 3 Nov
Hiring · 30d
15
+1 net · open roles
TypeScriptJavaScriptReactNode.jsPythonSwift/iOSAndroidReact NativeLLMs

Shape the Future with TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.

Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.

Our Digital Expertise

  • Transformation Experts: We transform traditional business models into agile, AI-powered ecosystems.
  • Strategic Visionaries: We navigate the uncharted waters of technological evolution.
  • Product Virtuosos: We orchestrate the creation of world-class digital solutions.
  • Code Optimizers: We leverage AI to refine and perfect digital systems.

Our Technological Toolkit

  • Mobile & Web Development: (iOS, Android, React Native, React, Node.js)
  • Voice-Activated Platforms: (Amazon Alexa, Google Home)
  • Connected Ecosystems: (Cars and Homes)
  • Streaming Platforms: (Roku, Fire TV, Android TV, tvOS)

The TribalScale Professional

You thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job; you seek a calling—a chance to make a lasting impact on the digital landscape.

Agentic QA Engineer

Job title: Agentic QA Engineer

Company: TribalScale

Location: [To be confirmed]

Employment type: [To be confirmed]

About TribalScale

TribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.

About the Role

TribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.

This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.

The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.

Key Responsibilities

  • Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
  • Build automated test frameworks for functional, integration, regression, and end-to-end testing.
  • Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
  • Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
  • Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
  • Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
  • Integrate automated testing and quality checks into CI/CD pipelines.
  • Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
  • Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
  • Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.

Required Qualifications

  • Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
  • Proficiency in Python, JavaScript, TypeScript, or another relevant programming language.
Source · TribalScaleFirst seen 4 NovOriginal ↗