1. Home
  2. Jobs
  3. Distributed Serving

Distributed Serving Jobs

Browse 599 Distributed Serving jobs on Inference Jobs.

599 jobs

1wHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
5dCO

Director of Engineering, Inference Services

CoreWeave

Sunnyvale, California, United States (Hybrid)$206k – $303k Yearly
2wSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175k – $280k Yearly
1wCO

Member of Technical Staff, MLE (Korea)

Cohere

Seoul, Seoul, South Korea or Remote (South Korea)
1wCO

Member of Technical Staff, Modeling

Cohere

London, England, United Kingdom or Remote (Worldwide)
5dCO

Senior Software Engineer II, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$165k – $242k Yearly
1wCA

Software Engineer

Cartesia

San Francisco, California, United States (On-site)$180k – $250k Yearly
2wPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
2wAN

Software Engineer, AI Reliability

Anthropic

San Francisco, California, United States (Hybrid)$325k – $485k Yearly
1wBA

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, United States (On-site)$220k – $285k Yearly
1wOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325k – $490k Yearly
2wRE

Software Engineer, Distributed Systems

Replit

Foster City, California, United States (Hybrid)$130k – $290k Yearly
1wBA

Software Engineer - Model API's

Baseten

San Francisco, California, United States (On-site)$150k – $230k Yearly
2wPL

Distributed Training Engineer

Periodic Labs

Menlo Park, California, United States (Hybrid)
1wCO

Member of Technical Staff, Post-Training

Cohere

London, England, United Kingdom (Hybrid)
2wAI

Senior Software Engineer - ML Infrastructure

Applied Intuition

Sunnyvale, California, United States (On-site)$153k – $222k Yearly
2dCO

Senior Software Engineer I, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$139k – $204k Yearly