Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Inference Infrastructure

Inference Infrastructure Jobs

Explore Inference Infrastructure roles on Inference Jobs and apply today.

2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
1mo agoAN

Sr. Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£225K – £325K Yearly
Software Engineering
Infrastructure Engineering
Distributed Systems
Machine Learning Systems
2mo agoAN

Staff Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£325K – £390K Yearly
Software Engineering
Distributed Systems
Distributed Systems
Machine Learning
2mo agoXA

Software Engineer - Applied Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Software Engineering
Machine Learning Infrastructure
Kubernetes
SGLang
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
2mo agoAN

Staff + Senior Software Engineer, Cloud Inference

Anthropic

San Francisco, California, United States (Hybrid)$300K – $485K Yearly
Software Engineering - Infrastructure
Cloud Infrastructure
AWS
GCP
3w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
3mo agoOP

Researcher, Training

OpenAI

San Francisco, California, United States (Hybrid)$360K – $440K Yearly
AI Research
Machine Learning Research
LLM Architectures
Deep Learning
3mo agoCD

Software Engineer, Infrastructure

Chai Discovery

San Francisco, California, United States (On-site)
Infrastructure Engineering
Software Engineering
Infrastructure
AI/ML Systems
2mo agoDE

Staff Software Engineer, ML Infrastructure

Decagon

San Francisco, California, United States (On-site)$300K – $430K Yearly
Engineering
Infrastructure Engineering
Python
PyTorch
2mo agoXA

Member of Technical Staff, Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Machine Learning Engineer
AI Infrastructure
Python
Rust
3mo agoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference
HIP
CUDA
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
1mo agoAN

Engineering Manager, Cloud Inference AWS

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly
Engineering Management
Cloud Engineering
AWS
Cloud Inference