Inference Engineering Jobs in United States

ML Infrastructure Engineering

Model Inference

Distributed Systems

3w ago

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200K – $290K Yearly

Research Engineering

Machine Learning Infrastructure

2w ago

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Inference Engineering

AI Research & Engineering

3d ago

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

3w ago

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly

Engineering Management

Machine Learning

4w ago

Software Engineer, Inference - Performance Optimization

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

Scaling

Inference

Performance Profiling

Benchmarking

4w ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly

AI Engineering

Machine Learning Engineer

Rust

4w ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

LLM Inference

Distributed Serving

5d ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly

Performance Engineering

Inference Systems

SQL

4w ago

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

4d ago

Applied AI Inference Engineer

Crusoe

San Francisco, California, United States (On-site)$250K – $300K Yearly

4w ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

2w ago

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly

Software Engineering

3d ago

Inference Software Engineer

Etched

San Jose, California, United States (On-site)$175K – $275K Yearly

Inference Engineering

AI Infrastructure

Machine Learning Engineer

Rust

2w ago

Machine Learning Engineer - Inference

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly

Inference Engineer

Machine Learning Infrastructure

PyTorch

2w ago

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

2w ago

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

3d ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2K – $262.2K Yearly

LLM Inference Optimization

PyTorch

1w ago

Senior Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly

AI Inference Engineering

LLM Serving Engineering

2w ago

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$184K – $287.5K Yearly

Software Engineering

Rust