LLM Infrastructure Engineering Jobs

Machine Learning Engineering

2w ago

Engineering Manager, Inference ML Runtime

Cerebras

Sunnyvale, California, United States (On-site)

Engineering Management

C++

2w ago

Senior Software Engineer, Agent Infrastructure

Cohere

Canada + 1 more (Remote)

4d ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly

Machine Learning Infrastructure

AI Engineer

PyTorch

VLLM

2w ago

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly

AI Infrastructure

PyTorch

JAX

3d ago

Engineering Manager, Inference Benchmarking — AI Perf

NVIDIA

United States (Remote)$224K – $356.5K Yearly

Engineering Management

Performance Engineering

LLM Inference

vLLM

3w ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320K – $485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

LLM Serving

2w ago

Machine Learning Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $220K Yearly

AI Engineer

Machine Learning

LLMs

2w ago

Engineering Manager, Inference Routing and Performance

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly

Engineering Management

Inference Routing

4d ago

Senior AI Infrastructure Software Engineer

NVIDIA

Shanghai, Shanghai, China (Hybrid)

2w ago

Senior Software Engineer – TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$152K – $287.5K Yearly

2w ago

Research Engineer, Pretraining Scaling

Anthropic

San Francisco, California, United States (On-site)$350K – $850K Yearly

Research Engineer

ML Infrastructure Engineering

JAX

TPU

18h ago

Field Engineering Intern - Summer 2026

Lambda

San Francisco, California, United States (Hybrid)$51 – $65 Hourly

Field Engineering

Machine Learning

2w ago

Solutions Architect, Infrastructure

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly

Solutions Architecture

Solutions Architecture

2w ago

Staff Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£325K – £390K Yearly

Machine Learning

2w ago

Senior Software Engineer, Managed AI

Crusoe

San Francisco, California, United States (On-site)$172.4K – $209K Yearly

AI/ML Engineering

Large Language Models

2w ago

Full Stack LLM Engineer

Cerebras

Toronto, Ontario, Canada (On-site)

AI Engineering

AI Research & Engineering

PyTorch

2w ago

Research Engineer, Pretraining Scaling (London)

Anthropic

London, England, United Kingdom (On-site)£260K – £630K Yearly

JAX

TPU

6d ago

Backend Software Engineer (Evals) – Support Automation Engineering

OpenAI

San Francisco, California, United States (On-site)$230K – $385K Yearly

Backend Engineering

FastAPI

2w ago

Sr. Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£225K – £325K Yearly