Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Distributed Serving

Distributed Serving Jobs

Explore Distributed Serving roles on Inference Jobs and apply today.

3mo agoMO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150K – $270K Yearly
Engineering
Machine Learning Engineer
PyTorch
vLLM
3mo agoBA

Forward Deployed SRE

Baseten

San Francisco, California, United States (On-site)$150K – $225K Yearly
Site Reliability Engineering
Forward Deployed Engineering
Kubernetes
Grafana
3mo agoOP

Full Stack Engineer, Fleet Scheduling

OpenAI

San Francisco, California, United States (Hybrid)$255K – $490K Yearly
Full Stack Engineering
Software Engineering
React
Vue
3mo agoOP

Backend Software Engineer (Evals) – Support Automation Engineering

OpenAI

San Francisco, California, United States (On-site)$255K – $405K Yearly
Backend Engineering
Machine Learning Engineer
Python
FastAPI
3mo agoCA

Forward Deployed Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Engineering
Software Engineering
State Space Models
Python
3w agoCR

Staff Software Engineer

Crusoe

San Francisco, California, United States (On-site)$208K – $253K Yearly
Software Engineering
Infrastructure Engineering
Kubernetes
Go
1w agoAN

Software Engineer, ML Networking

Anthropic

San Francisco, California, United States (Hybrid)$280K – $850K Yearly
Software Engineering
Network Engineering
Network Protocols
TCP/IP Stack
3mo agoRA

Member of Technical Staff - Data Ingestion Engineer

Reflection AI

San Francisco, California, United States (On-site)
Data Engineering
Data Ingestion
Data Ingestion
Web Crawling
2mo agoNV

Senior System Architect, Infrastructure Reliability

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Site Reliability Engineering
Infrastructure Engineering
EDA
CPU Architecture
2mo agoCO

Senior Software Engineer, Observability Insights

CoreWeave

New York, United States (Hybrid)$165K – $242K Yearly
Software Engineer
Backend Engineer
Go
Python
2mo agoNV

Senior Research Scientist, Multi-Modal Language Models

NVIDIA

Santa Clara, California, United States (On-site)$192K – $356.5K Yearly
AI Research
Research Scientist
Multi-Modal Language Models
Computer Vision
3mo agoCO

Staff Production Engineer

CoreWeave

Livingston, New Jersey, United States (Hybrid)$188K – $275K Yearly
Production Engineering
Site Reliability Engineering
Distributed Systems
Cloud Platforms