Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Inference Systems

Inference Systems Jobs

Explore Inference Systems roles on Inference Jobs and apply today.

2d agoNV

Senior Software Engineer, AI Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)C$135K – C$220K Yearly
Software Engineering
AI/ML Engineering
LLM Serving
vLLM
3w agoTM

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Machine Learning Infrastructure
AI Infrastructure
PyTorch
JAX
3w agoTA

Machine Learning Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $220K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
LLMs
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
3mo agoCO

Member of Technical Staff, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
Modeling
Machine Learning Engineer
C++
Python
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
3mo agoCO

Senior Software Engineer I, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$139K – $204K Yearly
Software Engineer
Backend Engineer
Python
Go
2mo agoTA

Research Engineer, Core ML

Together AI

San Francisco, California, United States (On-site)$200K – $280K Yearly
Machine Learning Research
Machine Learning Engineer
RL Algorithms
Inference Optimization
3mo agoCD

Software Engineer, Infrastructure

Chai Discovery

San Francisco, California, United States (On-site)
Infrastructure Engineering
Software Engineering
Infrastructure
AI/ML Systems
2mo agoAN

Software Engineer, Inference Deployment

Anthropic

San Francisco, California, United States (Hybrid)$320K – $485K Yearly
Software Engineering
Infrastructure Engineering
Kubernetes
Python
3mo agoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference
HIP
CUDA
2mo agoAN

Staff + Senior Software Engineer, Cloud Inference

Anthropic

San Francisco, California, United States (Hybrid)$300K – $485K Yearly
Software Engineering - Infrastructure
Cloud Infrastructure
AWS
GCP