ML Inference Infrastructure Jobs

Compiler Development

2mo agoNV

Senior Machine Learning Applications and Compiler Engineer

NVIDIA

Toronto, Ontario, CAC$135K – C$220K Yearly

Compiler Engineer

Compiler Engineering

1w agoAN

ML Infrastructure Engineer, Safeguards

Anthropic

San Francisco, California, United States (Hybrid)$320K – $405K Yearly

Deep Learning Engineering

MLOps

Python

PyTorch

1mo agoNV

Inference Optimization Architect, Speech AI

NVIDIA

Pune, Maharashtra, India (On-site)

AI Infrastructure

Inference Optimization

Speech AI

4w agoCE

Inference Core Platform Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

Platform Engineering

Python

Infrastructure as Code (IaC)

1w agoPR

Senior MLOps Engineer

Prolific

United Kingdom (Remote)

Data & AI

MLOps

Terraform

2mo agoNV

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly

Software Engineering

Machine Learning Engineering

Deep Learning

2mo agoNV

Senior Machine Learning Applications and Compiler Engineer

NVIDIA

Santa Clara, California, US$152K – $287.5K Yearly

Compiler Engineer

Rust

3w agoTM

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly

AI Infrastructure

PyTorch

JAX

3w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly

Research Engineering

High-Performance Inference

Model Execution

2mo agoTA

Research Engineer, Core ML

Together AI

San Francisco, California, United States (On-site)$200K – $280K Yearly

Machine Learning Research

Machine Learning Research

RL Algorithms

Inference Optimization

2w agoGR

Distinguished Engineer - Inference Serving Network and Storage

Graphcore

Austin, Texas, United States (On-site)

1mo agoCE

Principal ML Investigator

Cerebras

Sunnyvale, California, United States (On-site)

AI Research

Large Language Models

3w agoET

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Inference Engineering

Python

3mo agoCO

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, United States or Remote (United States + 2 more)

2mo agoAI

Senior Software Engineer - ML Infrastructure

Applied Intuition

Sunnyvale, California, US$153K – $222K Yearly

Software Engineering

3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly

Inference Engineering

AI Infrastructure

Inference

GPU Computing

1mo agoAC

Infrastructure Engineer, ML Systems

Applied Compute

San Francisco, California, United States (On-site)

Infrastructure Engineer

Platform Engineer

Kubernetes

AWS

1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly

AI Engineering