Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. AI Inference Engineering

AI Inference Engineering Jobs

Explore AI Inference Engineering roles on Inference Jobs and apply today.

3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust
3mo agoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
3mo agoOP

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineering
Machine Learning
PyTorch
NVIDIA GPUs
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
2mo agoCE

Inference Frontend

Cerebras

Sunnyvale, California, United States (On-site)
Software Engineering
Artificial Intelligence
C++
Compilers
2mo agoCE

Deployment Engineer, AI Inference

Cerebras

Sunnyvale, California, United States (On-site)
Deployment Engineer
DevOps Engineer
Python
Linux
4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
Inference
GPU Computing
2mo agoNV

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
Compiler Technologies
MLIR
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
2mo agoXA

Software Engineer - Applied Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Software Engineering
Machine Learning Infrastructure
Kubernetes
SGLang
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models