Perplexity Logo

Perplexity

AI Inference Engineer - SF or Palo Alto

Reposted 20 Days Ago
7 Locations
Mid level
7 Locations
Mid level
The role involves deploying machine learning models for real-time inference, developing APIs, optimizing inference systems, and ensuring their reliability.
The summary above was generated by AI

You will work on large-scale deployment of machine learning models for real-time inference.

Our current stack is Python, C++, TensorRT-LLM, Kubernetes.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.


Top Skills

C++
Cuda
Kubernetes
Onnx
Python
PyTorch
TensorFlow
Tensorrt-Llm

Similar Jobs

16 Days Ago
Floors, Oakview, MB, CAN
Senior level
Senior level
Insurance
The Software Engineer Lead Consultant designs and implements software products, manages production applications, and drives best practices in development and DevOps processes.
Top Skills: ActivemqAWSAws SqsAzureJavaJavaScriptJSONPythonRabbitMQShell ScriptTddTerraformVMwareYaml
12 Days Ago
Montréal, QC, CAN
Junior
Junior
Digital Media • Kids + Family • Music • News + Entertainment
The Product Engineer evaluates and approves designs for toy products, collaborates on part development, and ensures quality during production.
Top Skills: 3D SolidworksMS Office
15 Days Ago
2 Locations
Senior level
Senior level
eCommerce • Fintech • Machine Learning • Retail
This role involves planning and executing technology projects focused on performance and scalability, mentoring team members, and addressing production issues in distributed systems.
Top Skills: AWSCloudflareDatadogDynamoElasticsearchKotlinKubernetesPagerdutyRedis

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account