Deepgram Logo

Deepgram

Senior Systems Engineer – AI/ML Infrastructure

Posted 2 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
Design and maintain distributed systems infrastructure, including GPU clusters and network architectures. Implement monitoring and optimize storage solutions for AI/ML workloads.
The summary above was generated by AI

Company Overview

Deepgram is the leading voice AI platform for developers building speech-to-text (STT), text-to-speech (TTS) and full speech-to-speech (STS) offerings. 200,000+ developers build with Deepgram’s voice-native foundational models – accessed through APIs or as self-managed software – due to our unmatched accuracy, latency and pricing. Customers include software companies building voice products, co-sell partners working with large enterprises, and enterprises solving internal voice AI use cases. The company ended 2024 cash-flow positive with 400+ enterprise customers, 3.3x annual usage growth across the past 4 years, over 50,000 years of audio processed and over 1 trillion words transcribed. There is no organization in the world that understands voice better than Deepgram

Opportunity:

We are seeking an experienced Senior Systems Engineer – AI/ML Infrastructure to design, implement, and maintain our large-scale distributed systems infrastructure. You'll be responsible for building and optimizing our network architecture, storage solutions, and compute platforms that power our AI/ML workloads. This role combines expertise in network engineering, storage systems, and modern container orchestration platforms, with a focus on reliability, scalability, and cost-effectiveness.

What You’ll Do

  • Build and maintain bare-metal GPU compute clusters for AI training and inference workloads

  • Implement monitoring, alerting, and automation solutions for infrastructure management

  • Manage large-scale deployments using modern orchestration platforms like Kubernetes and Slurm

  • Design and implement reliable, high-performance network architectures for distributed systems

  • Architect and maintain large-scale storage solutions, including backup systems, distributed caching, and object storage

You’ll Love This Role If You

  • Are passionate about building reliable, scalable infrastructure systems

  • Enjoy optimizing complex distributed systems for performance and cost

  • Love solving challenging problems in networking and storage at scale

  • Are excited about working with cutting-edge GPU infrastructure

  • Want to work at the intersection of infrastructure and AI/ML systems

It’s Important To Us That You Have

  • 5+ years of experience in infrastructure engineering or similar roles

  • Strong background in network engineering and design for reliability

  • Experience with large-scale storage systems (distributed file systems, caching solutions)

  • Proven track record of managing bare-metal infrastructure

  • Expertise in container orchestration platforms (Kubernetes, Slurm)

  • Experience with GPU infrastructure management and optimization

  • Strong automation and scripting skills

  

It Would Be Great if You Had 

  • Experience with software-defined networking

  • Experience with infrastructure cost management and capacity planning

  • Familiarity with AI/ML workloads and their infrastructure requirements

  • Experience with multi-region infrastructure deployment

  • Background in performance optimization for distributed systems

Backed by prominent investors including Y Combinator, Madrona, Tiger Global, Wing VC and NVIDIA, Deepgram has raised over $85 million in total funding. If you're looking to work on cutting-edge technology and make a significant impact in the AI industry, we'd love to hear from you!

Deepgram is an equal opportunity employer. We want all voices and perspectives represented in our workforce. We are a curious bunch focused on collaboration and doing the right thing. We put our customers first, grow together and move quickly. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, gender identity or expression, age, marital status, veteran status, disability status, pregnancy, parental status, genetic information, political affiliation, or any other status protected by the laws or regulations in the locations where we operate.

We are happy to provide accommodations for applicants who need them.

Compensation Range: $150K - $220K


#BI-Remote

Top Skills

Caching Solutions
Container Orchestration
Distributed File Systems
Gpu Infrastructure
Kubernetes
Networking
Slurm

Similar Jobs at Deepgram

3 Days Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software
The Senior Software Engineer will design and implement services for speech processing, optimize performance, and debug complex system issues.
Top Skills: CC++PythonRustUnix
10 Days Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software
Design and implement secure, scalable backend services for Deepgram's AI products, focusing on speech processing and system optimization.
Top Skills: CC++PythonRustUnix
10 Days Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software
Design and implement scalable backend services for speech processing, optimizing performance, and working closely with product teams to enhance offerings.
Top Skills: CC++GitPythonRustUnixVersion Control

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account