Optimize, compress, and distill large language and vision models for on-device inference. Build pipelines for distillation and hardware-specific compilation, and benchmark performance across NPU/GPU architectures.
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar Jobs
Agency • Artificial Intelligence • Blockchain • Web3
Run adversarial tests on language and multimodal models, build guardrails and real-time filters for autonomous tool use, and support RLHF alignment and constitutional AI development to ensure safe AI deployment.
Top Skills:
Adversarial MlGuardrailsJailbreak TaxonomiesLlmsMultimodal AgentsPrompt EngineeringReal-Time FilteringRed-Teaming FrameworksRlhf
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provides technical support for production radiology systems affecting patient care. Responsibilities include responding to support calls, managing a 20–30 case ticket backlog, documenting incidents, troubleshooting Windows, network, server, hardware, storage, and Oracle database issues, and coordinating with internal teams to resolve customer cases. The role is Canada-based and includes weekday shifts beginning between 5:00 and 9:30 a.m. PST, plus an on-call rotation.
Top Skills:
Active DirectoryCC#C++Enterprise HardwareLanOracle DatabasesPacsPowershellPythonRisStorage SystemsTcp/IpWanWindowsWindows Command LineWindows ServerWindows Workstations
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead the technical design and delivery of banking features at Cash App, collaborating across teams, driving architecture improvements, and mentoring engineers.
Top Skills:
AWSDatadogDynamoDBGrpcGuiceHibernateHTTPJavaJettyJSONJunitKafkaKotlinMySQLOkhttpPrometheusProtocol BuffersSignalfx
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
