Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. LLM Inference

LLM Inference Jobs in United States

Discover LLM Inference roles in United States on Inference Jobs and apply today.

3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust
2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
3mo agoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
3d agoNV

Senior Deep Learning Software Engineer, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
Deep Learning Engineering
LLM Performance Engineering
Python
C++
1mo agoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
2mo agoNV

Senior Software Engineer – TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$152K – $287.5K Yearly
Software Engineering
AI Engineering
C++
CUDA
2mo agoNV

Senior Machine Learning Engineer, Quantized Inference

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly
Machine Learning Engineer
AI Engineer
Python
PyTorch
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
5d agoCE

Senior Performance Analyst, Inference

Cerebras

Sunnyvale, California, United States (On-site)
Performance Analysis
Product Management
vLLM
SGLang