Top AI Jobs in Ottawa

Design, build, and operate AWS-native AI/ML systems: RAG pipelines, fine-tuned LLMs, and microservices. Implement IaC (Terraform), CI/CD, policy guardrails, and production deployments integrating Bedrock/SageMaker, LangChain, and telemetry for secure, scalable enterprise use.

The AI Data Expert will review and evaluate AI-generated outputs and textual content, ensuring cultural relevance and quality. Responsibilities include content analysis, assessing multimedia materials, and providing structured annotations while adhering to detailed guidelines. Native fluency in French and strong English skills are essential, with previous experience in AI evaluation preferred.

Evaluate and review AI outputs, generate or assess content, and ensure cultural relevance and accuracy in various media for AI projects.

Design behavioral specs, harnesses, and validation systems so AI agents implement reliable full-stack features. Build CI gates, structural tests, linting, knowledge bases, and end-to-end verification. Diagnose failures across spec, harness, and agent layers. Architect and operate production systems across cloud and on-prem environments for regulated energy deployments, prioritizing reliability, observability, and graceful degradation.

The Applied AI Engineer will develop AI-powered systems to streamline internal processes, collaborating with various departments to enhance efficiency and automation. This role involves problem ownership, system design, and deploying solutions that leverage AI technology while ensuring user adoption and long-term value.

Design and build applications in Python, collaborate with clients, optimize performance, and ensure code quality in AI-driven projects.

Design and implement AI-driven tools to improve workflows across teams. Collaborate to identify internal problems AI can solve, and prototype solutions quickly.

Design and build a production multi-agent harness and MCP integrations that operate across ERPs, CRMs, and business tools. Own end-to-end production concerns (reliability, observability, permissions, safe workflow execution), scope the product, make architecture decisions, and ship features working closely with CTO, product, engineering, and design. Stay current with agent frameworks and use tools like Claude Code in development.

Evaluate AI outputs, perform audit-based reviews, identify failure modes and trends, apply and refine guidelines, communicate findings, participate in calibrations and stakeholder syncs, and help improve evaluation frameworks for human-in-the-loop AI.

Audit and ensure quality of data labeling outputs, coach and onboard Data Labeling Associates, provide actionable feedback, monitor workflows, identify patterns and edge cases, and help improve guidelines and processes in human-in-the-loop AI workflows.

Audit and review data labeling outputs, provide actionable feedback, train and support labeling teams, monitor workflows, identify recurring issues and edge cases, participate in calibrations and stakeholder syncs, and help improve guidelines and processes in human-in-the-loop AI workflows.

Evaluate AI model outputs, perform audit-style reviews to find patterns and failure modes, apply and refine labeling/evaluation guidelines, document findings, communicate insights to leads and stakeholders, and participate in team calibrations to improve model evaluation and data quality.

Evaluate AI model outputs, perform audit-based reviews, identify failure modes and trends, apply and improve guidelines, document findings, and collaborate with leads and cross-functional teams to refine quality standards.

Audit and ensure quality of labeled data by reviewing DLA outputs, providing feedback and coaching, supporting onboarding and training, monitoring workflows, identifying recurring issues and edge cases, and contributing to guideline and process improvements in human-in-the-loop AI workflows.

Audit and improve data labeling quality in human-in-the-loop ML workflows. Coach and onboard labelers, provide actionable feedback, monitor queues, identify recurring issues, and help refine guidelines and processes.

Evaluate AI outputs, audit model behavior, apply and refine labeling guidelines, identify failure modes and trends, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Evaluate AI outputs and audit model behavior, apply and refine guidelines, identify failure modes and trends, document findings, and collaborate with leads and cross-functional teams to improve evaluation frameworks and data quality.

Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Audit and ensure quality of data labeling outputs, coach and onboard annotators, enforce and improve guidelines, identify recurring issues and edge cases, escalate risks, and document feedback to support human-in-the-loop AI workflows.

Audit and ensure quality of data labeling outputs, coach and onboard annotators, apply and refine guidelines, monitor workflows and escalate issues, document findings, and support human-in-the-loop AI evaluation processes.

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Perform rating and annotation tasks for AI development following project guidelines. Maintain accuracy, meet deadlines, communicate in French-Canadian and English, and complete research within short throughputs. Temporary freelance role, 15–20+ hours/week, remote.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.