Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. United States
  4. California
  5. San Francisco
  6. LLM Inference

LLM Inference Jobs in San Francisco, California, United States

Browse 30 LLM Inference jobs in San Francisco, California, United States on Inference Jobs.

30 jobs
4w agoTogether AI logoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
2w agoCartesia logoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
2w agoOpenAI logoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
1d agoTogether AI logoTA

Forward Deployed Engineer (Inference & Post-Training)

Together AI

San Francisco, California, United States (On-site)$270K – $300K Yearly
Inference Engineering
AI/ML Engineering
vLLM
TensorRT-LLM
2w agoPerplexity logoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly
AI Engineering
Machine Learning Engineer
Rust
Python
2w agoSesame logoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
PyTorch
VLLM
3w agoAnthropic logoAN

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly
Performance Engineering
Inference Systems
Python
SQL
2w agoBaseten logoBA

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260K – $380K Yearly
Engineering Management
Forward Deployed Engineering
Python
LLMs
4w agoTogether AI logoTA

Machine Learning Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $220K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
LLMs
2w agoPerplexity logoPE

Inference Engineering Manager

Perplexity

San Francisco, California, United States (On-site)$300K – $485K Yearly
AI
Engineering Management
Python
PyTorch
4w agoThinking Machines Lab logoTM

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Machine Learning Infrastructure
AI Infrastructure
PyTorch
JAX
4w agoTogether AI logoTA

Machine Learning Engineer - Inference

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
Inference Engineer
Python
PyTorch
1w agoLambda logoLA

Field Engineering Intern - Summer 2026

Lambda

San Francisco, California, United States (Hybrid)$51 – $65 Hourly
Field Engineering
ML Infrastructure Engineering
Python
Machine Learning
2w agoBaseten logoBA

Software Engineer - Model Performance

Baseten

San Francisco, California, US or Remote (Worldwide)$180K – $360K Yearly
Software Engineering
Machine Learning Engineering
Python
C++
4w agoOpenAI logoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
4w agoTogether AI logoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
Subscribe to this search

Get email updates when new jobs match this search.