AI Inference Engineer

Posted 11 Days Ago
7 Locations
Expert/Leader
Artificial Intelligence • Software
The Role
As an AI Inference Engineer, you will develop APIs for AI inference, optimize ML systems, benchmark performance, enhance system reliability, and implement optimizations for LLM inference.
Summary Generated by Built In

We are looking for an AI Inference to join our growing team. Our current stack is Python, C++, TensorRT-LLM, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Experience with deploying reliable, distributed, real-time model serving at scale
  • (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $240,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.


To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.

 

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

 

Equity: In addition to the base salary, equity is part of the total compensation package.

Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

 

Top Skills

C++
Python
The Company
HQ: San Francisco, California
41 Employees
On-site Workplace
Year Founded: 2022

What We Do

The most powerful answer engine. Powering curiosity with answers backed by up-to-date sources. This is where knowledge begins.

Similar Jobs

Cash App Logo Cash App

Senior Machine Learning Engineer - Identity

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote
8 Locations
3500 Employees

Capco Logo Capco

Quality Engineer (Automation) (Toronto, Hybrid)

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Toronto, ON, CAN
6000 Employees

Babylist Logo Babylist

Staff Android Engineer

eCommerce • Healthtech • Kids + Family • Retail • Social Media
Easy Apply
Remote
Canada
300 Employees

Cloudflare Logo Cloudflare

Solution Architect, Sales Incentive Compensation Management (ICM)

Cloud • Information Technology • Security • Software • Cybersecurity
Remote
Ontario, ON, CAN
3900 Employees

Similar Companies Hiring

Snyk Thumbnail
Software • Security • Information Technology • Data Privacy • Cybersecurity • Cloud • Artificial Intelligence
Boston, MA
1000 Employees
UL Solutions Thumbnail
Software • Renewable Energy • Professional Services • Energy • Consulting • Chemical • Automotive
Chicago, IL
15000 Employees
Consensus Cloud Solutions Thumbnail
Software • Information Technology • Healthtech • Cloud • Business Intelligence • Artificial Intelligence
Los Angeles, CA
398 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account