Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. California
  5. LLM Inference

LLM Inference Jobs in California, United States

Discover LLM Inference roles in California, United States on Inference Jobs and apply today.

3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
4w agoTA

Machine Learning Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $220K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
LLMs
3mo agoCO

Member of Technical Staff, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
Modeling
Machine Learning Engineer
C++
Python
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
3mo agoBA

Software Engineer - Model Performance

Baseten

San Francisco, California, United States (On-site)$150K – $250K Yearly
Engineering
Model Performance
LLM Inference
TensorRT
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust
2mo agoNV

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
Compiler Technologies
MLIR
3mo agoOP

Researcher, Training

OpenAI

San Francisco, California, United States (Hybrid)$360K – $440K Yearly
AI Research
Machine Learning Research
LLM Architectures
Deep Learning
3mo agoPO

Member of Engineering (Pre-training and inference software)

Poolside

United Kingdom or Remote (Europe, Middle East, and Africa, North America)
Machine Learning Engineer
LLM Training
Python
PyTorch
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
1mo agoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
1mo agoNE

Senior Sales Engineer

Nebius

United States (Remote)$152K – $228K Yearly
Sales Engineering
Solutions Engineering
AI Inference
GPU Computing
20h agoCE

Senior Performance Analyst, Inference

Cerebras

Sunnyvale, California, United States (On-site)
Performance Analysis
Product Management
vLLM
SGLang