Design and integrate vision and audio models into agent reasoning loops, optimize streaming latency for voice-to-voice interactions, and architect multimodal RAG systems to retrieve insights from videos and PDFs.
We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimodal retrieval capabilities, ensuring our systems are efficient and innovative.
Responsibilities:
- Integrate vision encoders and audio-native models into core agent reasoning loops.
- Optimize streaming latency for voice-to-voice AI interactions.
- Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.
Qualifications:
- Experience with Whisper, CLIP, and multimodal LLM integration.
- Knowledge of streaming architectures and WebRTC.
- Expertise in cross-modal alignment.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Serve as the primary post-implementation contact for top customers, craft joint success plans, run executive business reviews and workshops, mentor teammates, support French-speaking customers, and advise on customizing Samsara’s IoT platform to drive safety, efficiency, and sustainability.
Top Skills:
IotSamsara PlatformVehicle TelematicsVideo-Based Safety
Gaming
Lead product vision, roadmap, and outcomes for Hit It Rich Slots. Drive monetization and live-ops strategy, coordinate cross-functional teams and partners, define analytics standards, and own long-term player engagement, retention, and revenue growth.
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Lead design and delivery of scalable ML systems across the full lifecycle for recommendations, forecasting, targeting, and personalization. Collaborate with engineers and product teams, set modeling and productionization standards, mentor data scientists, guide architecture and experimentation, and apply cloud and MLOps best practices to drive measurable product and business impact.
Top Skills:
AthenaAWSBedrockCi/CdDynamoDBGlueLlm Fine-TuningMl Ops FrameworksPythonPyTorchRlhfSagemakerScikit-LearnSQLTensorFlowVersion Control
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
