Inference Systems Jobs in United States

Rust

Machine Learning Engineer

3w ago

Member of Technical Staff, Inference & RL Systems

Magic

San Francisco, California, United States (On-site)$225K – $550K Yearly

Software Engineer

Distributed Systems

Reinforcement Learning

2w ago

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly

2h ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly

Inference Engineering

Model Inference

Distributed Systems

6d ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly

Performance Engineering

Inference Systems

SQL

2w ago

System Software Engineer, Dynamo-Triton Inference Server - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly

System Software Engineer

GPU Software Development

Rust

Software Development Engineer in Test

1d ago

Senior Inference Platform SDET

Cerebras

Sunnyvale, California, United States (On-site)

Platform Engineering

4d ago

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

1d ago

Staff Inference ML Runtime Engineer

Cerebras

United States (On-site)

Software Engineering

Machine Learning Infrastructure

2w ago

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Inference Engineering

ML Infrastructure Engineering

3w ago

Member of Technical Staff - Inference Research

Modal

New York, United States (On-site)$150K – $350K Yearly

Engineering

LLM Inference

Speculative Decoding

3w ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

ML Infrastructure Engineering

Distributed Systems Architecture

1d ago

Principal Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Software

Cloud Computing

Cloud Infrastructure

3w ago

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200K – $290K Yearly

Research Engineering

ML Infrastructure Engineering

Cloud Infrastructure Engineering

1d ago

Software Engineer, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)

Software Engineering

3w ago

Staff Software Engineer, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$188K – $275K Yearly

Staff Software Engineer

Inference Engineering

Cloud Infrastructure Engineering

1d ago

Staff Software Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

1d ago

Staff Software Engineer, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Platform Engineering

Machine Learning Infrastructure

1w ago

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly

Research Engineering

High-Performance Inference

Model Execution

4w ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering