Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Inference Engineer

Inference Engineer Jobs

Explore Inference Engineer roles on Inference Jobs and apply today.

1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
Inference
GPU Computing
3w agoOP

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly
Machine Learning
Inference Engineering
CUDA
ML Runtimes
2mo agoNV

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
Compiler Technologies
MLIR
2mo agoXA

Member of Technical Staff, Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Machine Learning Engineer
AI Infrastructure
Python
Rust
2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
2mo agoNV

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Software Engineering
Machine Learning Engineering
Deep Learning
C++
3w agoTA

Senior Backend Engineer, Inference Platform

Together AI

San Francisco, California, United States (On-site)$160K – $250K Yearly
Backend Engineering
Platform Engineering
Rust
Go
2mo agoNV

Senior Software Engineer, Quantized Inference

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly
Software Engineering
Machine Learning Engineer
Python
C++
3mo agoPO

Member of Engineering (Pre-training and inference software)

Poolside

United Kingdom or Remote (Europe, Middle East, and Africa, North America)
Machine Learning Engineer
LLM Training
Python
PyTorch
1mo agoNV

Senior Deep Learning Engineer

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly
Deep Learning Engineer
AI Engineer
Deep Learning
PyTorch
1mo agoAN

Sr. Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£225K – £325K Yearly
Software Engineering
Infrastructure Engineering
Distributed Systems
Machine Learning Systems
3mo agoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference
HIP
CUDA
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++