Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. ML Infrastructure Engineering

ML Infrastructure Engineering Jobs

Browse 26 ML Infrastructure Engineering jobs on Inference Jobs.

26 jobs
2w agoSambaNova logoSA

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200K – $275K Yearly
Software Engineering
ML Infrastructure
Python
vLLM
1w agoApplied Compute logoAC

Infrastructure Engineer, ML Systems

Applied Compute

San Francisco, California, United States (On-site)
Infrastructure Engineer
ML Systems Engineer
Kubernetes
Distributed Systems
1w agoAnthropic logoAN

ML Infrastructure Engineer, Safeguards

Anthropic

San Francisco, California, United States (Hybrid)$320K – $405K Yearly
Machine Learning Engineer
MLOps
Python
PyTorch
1d agoGraphcore logoGR

Staff Engineer (ML Engineer)

Graphcore

Cambridge, England, United Kingdom (On-site)
Machine Learning Engineering
ML Quality Assurance
Python
PyTorch
4w agoCartesia logoCA

Software Engineer, Data Infrastructure

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Software Engineering
Data Infrastructure Engineering
ML Data Infrastructure
Data Pipelines
4w agoModal logoMO

Forward Deployed ML Engineer

Modal

New York, United States (On-site)$180K – $250K Yearly
Forward Deployed Engineer
Machine Learning Engineer
Machine Learning
MLOps
4w agoSesame logoSE

ML Engineer

Sesame

San Francisco, California, United States (On-site)$190K – $320K Yearly
Machine Learning
Machine Learning Engineer
PyTorch
LLMs
1d agoGraphcore logoGR

Senior Engineer (ML Engineer)

Graphcore

Bristol, England, United Kingdom (On-site)
ML Engineer
Machine Learning QA
Python
PyTorch
7d agoThinking Machines Lab logoTM

Research Infrastructure Engineer, Research Acceleration

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Research Infrastructure (ML Infra)
Machine Learning Engineer
Python
Rust
1w agoScale logoSC

ML Research Engineer, ML Systems

Scale

San Francisco, California, United States (On-site)$218.4K – $273K Yearly
Machine Learning Engineer
ML Research
CUDA
PyTorch
4w agoModal logoMO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150K – $350K Yearly
Engineering
Machine Learning Engineer
PyTorch
vLLM
3w agoLambda logoLA

Field Engineering Intern - Summer 2026

Lambda

San Francisco, California, United States (Hybrid)$51 – $65 Hourly
Field Engineering
ML Infrastructure Engineering
Python
Machine Learning
4w agoOpenAI logoOP

Software Engineer, ML Systems & Training Architecture

OpenAI

San Francisco, California, United States (On-site)$295K – $380K Yearly
Robotics
Research
Code Review
Debugging
Subscribe to this search

Get email updates when new jobs match this search.

ML Infrastructure Engineering salary FAQs

These figures come from 7 ML Infrastructure Engineering jobs on Inference Jobs that include salary data. The middle 50% of advertised salaries fall between $165K and $343.3K, with the overall range spanning $192.6K – $336K. Pay spans about $212.4K across 2 seniority levels, from mid-level to senior. All figures are converted to annual USD with outliers removed. These are base salary ranges only and don't include bonuses, equity, or benefits.