As a Senior Software Developer in Test, you will design test plans, create automation strategies, enhance CI/CD, and ensure product reliability and performance.
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
About the Position
We are looking for a Software Developer in Test (SDET) to design comprehensive test plans and establish a scalable test automation strategy across all of CentML’s products, ensuring reliability, performance, and efficiency. You will be responsible for designing and building automated testing, CI/CD enhancements, and robust validation frameworks.
This role is ideal for someone passionate about quality, and test automation, who thrives in a fast-paced startup environment.
What you’ll do
- Evaluate our existing quality and performance testing frameworks, identify and document gaps
- Design, build, and maintain test frameworks for backend APIs, and user-facing UIs.
- Develop and automate end-to-end integration tests, performance tests, and stress tests for workloads running on distributed systems.
- Enhance CI/CD pipelines with automated test execution, validation, and reporting.
- Identify, document, and track defects, working with teams to troubleshoot and resolve issues quickly.
- Improve test coverage and reliability while optimizing execution time.
- Conduct exploratory and manual testing when necessary to supplement automation.
What you’ll need to be successful
- 5+ years of experience in software development or test automation, ideally in ML systems, distributed computing, or cloud infrastructure.
- Strong programming skills in Python (preferred), Go, or C++, with experience in test automation frameworks.
- Hands-on experience with PyTest, Playwright, JUnit, or similar frameworks.
- Deep understanding of CI/CD pipelines (GitHub Actions, Jenkins, or GitLab CI) and how to integrate automated tests.
- Experience with containerization (Docker, Kubernetes) and cloud platforms like AWS, GCP, or Azure
- Experience in performance testing, load testing, and profiling distributed systems is a plus.
- Knowledge of ML frameworks (TensorFlow, PyTorch, JAX) and experience testing ML models or infrastructure is a big bonus
- Familiarity with GPU/accelerator testing, scheduling, and monitoring tools is big bonus.
Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
Top Skills
AWS
Azure
C++
Docker
GCP
Github Actions
Gitlab Ci
Go
Jax
Jenkins
Junit
Kubernetes
Playwright
Pytest
Python
PyTorch
TensorFlow
Similar Jobs
Software
Design and maintain automation tools for QA and deployment processes across platforms, collaborating closely with SDK developers and QA teams.
Top Skills:
C#C++CypressGithub ActionsJenkinsNode.jsPlaywrightUnityUnrealWebsdk
Other
The Senior Software Developer - Test drives software architecture, leads Scrum teams, collaborates on satellite software development, and ensures high-quality testing processes.
Top Skills:
C++Cloud TechnologyContainerizationGoJavaPowershellPythonVirtualization
Payments
As a Senior Software Engineer in Test, you will design, build, and test software products with automation and ensure high quality and stability through comprehensive testing and problem-solving responsibilities.
Top Skills:
AWSAzureBashBlazemeterCucumberGroovyJavaJenkinsJmeterKubernetesMavenPerlPythonRubySeleniumTestngVagrantVirtualbox
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
