Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Distributed Inference

Distributed Inference Jobs

Explore Distributed Inference roles on Inference Jobs and apply today.

3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
4w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
3w agoET

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)
Inference Engineering
Machine Learning Infrastructure
C++
Python
3mo agoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
2mo agoXA

Software Engineer - Applied Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Software Engineering
Machine Learning Infrastructure
Kubernetes
SGLang
3mo agoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference
HIP
CUDA
2mo agoAN

Staff Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£325K – £390K Yearly
Software Engineering
Distributed Systems
Distributed Systems
Machine Learning
4w agoAN

Staff Software Engineer, Inference

Anthropic

County Dublin, Ireland (Hybrid)€295K – €355K Yearly
AI Research & Engineering
Software Engineering
Distributed Systems
Python
2mo agoCE

Inference Frontend

Cerebras

Sunnyvale, California, United States (On-site)
Software Engineering
Artificial Intelligence
C++
Compilers
1mo agoAN

Sr. Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£225K – £325K Yearly
Software Engineering
Infrastructure Engineering
Distributed Systems
Machine Learning Systems
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
4w agoTA

Machine Learning Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $220K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
LLMs