Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Reposted 4 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

2 Hours Ago
Remote or Hybrid
CA
Senior level
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead GTM strategy and operations for Global Account Management to improve retention, reduce churn, and drive expansion. Build coverage models, book construction, KPIs, dashboards, and operational cadence. Automate workflows and AI-driven experiments across CRM and GTM tools. Partner cross-functionally with Data Science, Product, Engineering, Finance, and AM to translate strategy into scalable programs, technical requirements, and measurable impact.
Top Skills: APIsClayCRMLookerN8NSalesforceSnowflakeSQLZapier
2 Hours Ago
Remote or Hybrid
CA
Expert/Leader
Expert/Leader
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead vision-heavy product design for Square Point of Sale: craft visual and interaction designs, build prototypes, collaborate with product and engineering, integrate AI-driven experiences, and drive projects from concept through shipped product while raising design standards and systems thinking.
2 Hours Ago
Remote or Hybrid
CA
Expert/Leader
Expert/Leader
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead and build Square's global commercial operating system, owning Deal Desk, pricing operations, strategic deal support, and commercial governance. Drive pricing execution, approval workflows, AI-enabled automation, reporting, and cross-functional alignment to increase deal velocity, consistency, and profitability while managing a global team.

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account