The AI Tester/Architect Consultant will design and execute test strategies for AI applications, ensuring functionality, performance, and reliability through collaboration and automation.
49 Solutions is seeking an experienced AI Tester / Architect Consultant to join our client at IRCC for innovative projects within the Canadian Federal Government. You will play a critical role in ensuring the functionality, performance, and reliability of AI applications, combining technical expertise with a deep understanding of AI technologies to contribute effectively across multiple initiatives.
Requirements
What You’ll Do:
- Design, develop, and execute test strategies for AI applications, including AI agents, RAG, and LLMs. Create test plans and cases, conduct functional, performance, and integration testing, identify potential model biases and edge cases, and collaborate with developers and data scientists to improve AI reliability and accuracy.
- Leverage AI tools to test applications on a regular basis, using prompts and outputs to generate and maintain test cases that evolve as AI models are updated or modified.
- Evaluate and validate machine learning models, algorithms, and AI frameworks such as TensorFlow, Keras, and PyTorch to ensure optimal performance and accuracy.
- Implement test automation for AI systems using Python, Java, or R to streamline testing processes and ensure repeatable results.
- Collaborate with cross-functional teams to identify, analyze, and resolve performance or functionality issues, ensuring AI applications meet project requirements.
- Support DevOps processes and CI/CD pipelines in AI application deployment, enabling seamless integration and continuous delivery.
- Ensure compliance with best practices and security requirements for federal government projects, maintaining high standards of quality and reliability.
What We’re Looking For:
- Minimum 5 years of experience in software testing or test automation, specifically with AI applications.
- Strong proficiency with AI frameworks, testing tools, and AI technologies.
- Experience with AI agents, RAG, LLMs, and machine learning models.
- Strong programming skills in Python, Java, or R.
- Familiarity with DevOps processes and CI/CD pipelines.
- Excellent analytical, problem-solving, and communication skills.
- A degree in Computer Science, Engineering, or a related field.
- A valid Canadian Government Security Clearance is a non-negotiable
Benefits
Remote/Hybrid Work
Top Skills
AI
Java
Keras
Python
PyTorch
R
TensorFlow
49 Solutions Ottawa, Ontario, CAN Office
1188 Wellington St, Ottawa, Ontario, Canada
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Senior Platform Consultant will plan, deploy, and provide operational support for CrowdStrike Falcon Cloud Security, engaging with customers and integrating security solutions while mentoring team members.
Top Skills:
AWSAzureBashCi/CdCloud SecurityCloudFormationDockerGCPKubernetesLinuxmacOSPowershellPythonTerraformWindows
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Provide proactive technical support to Premium Support customers, ensuring their success through onboarding, training, issue resolution, and advocating for their needs.
Top Skills:
LinuxmacOSPythonRestapiWindows Server Operating Systems
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The Account Executive will manage public sector client relationships, lead account planning, coordinate internal resources, and facilitate contract renewals while ensuring compliance and effective communication.
Top Skills:
Business AdministrationProject Management
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
