Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. ML Inference Infrastructure

ML Inference Infrastructure Jobs

Explore ML Inference Infrastructure roles on Inference Jobs and apply today.

3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
1mo agoTA

Engineering Manager, Model Serving

Together AI

San Francisco, California, United States (On-site)$250K – $300K Yearly
Engineering Manager
Machine Learning Engineering
Kubernetes
Multi-cluster Orchestration
3h agoCE

Senior Performance Analyst, Inference

Cerebras

Sunnyvale, California, United States (On-site)
Performance Analysis
Product Management
vLLM
SGLang
3mo agoCO

Audio Inference Engineer, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
AI Infrastructure
Machine Learning Engineer
C++
Python
1w agoAN

Engineering Manager, ML Acceleration

Anthropic

San Francisco, California, United States (Hybrid)$500K – $850K Yearly
Engineering Management
ML Engineering
Machine Learning
Artificial Intelligence
2mo agoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
4w agoCO

Solutions Architect - HPC/AI/ML

CoreWeave

Livingston, New Jersey, United States (Hybrid)$165K – $220K Yearly
Solutions Architecture
Cloud Computing
Kubernetes
Cloud Infrastructure
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
1w agoAN

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly
AI Research & Engineering
Engineering Management
Machine Learning
AI
2d agoSC

Tech Lead Manager- MLRE, ML Systems

Scale

San Francisco, California, United States (On-site)$264.8K – $331K Yearly
Machine Learning
MLOps
LLM
Distributed Systems
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust