1. Home
  2. Jobs
  3. Distributed Serving

Distributed Serving Jobs

Browse 599 Distributed Serving jobs on Inference Jobs.

21-40 of 599 jobs

2wNV
2wTA

Staff Engineer, Distributed Storage and HPC & AI Infrastructure

Together AI

Amsterdam, North Holland, Netherlands (Hybrid)
2wPE

Engineering Site Lead (London)

Perplexity

London, England, United Kingdom (Hybrid)
5dXA

Member of Technical Staff, RL Training Framework

xAI

Palo Alto, California, United States (On-site)$180k – $440k Yearly
1wOP

Distributed Training Engineer, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380k – $555k Yearly
3dTA

Staff Engineer, Distributed Storage and HPC & AI Infrastructure

Together AI

San Francisco, California, United States (On-site)$160k – $260k Yearly
2wMA

Distributed Systems Engineer

Magic

San Francisco, California, United States (On-site)$225k – $550k Yearly
1wOP

Software Engineer, Caching Infrastructure

OpenAI

San Francisco, California, United States (On-site)$255k – $405k Yearly
1wLA

Storage Engineering Manager

Lambda

San Jose, California, United States (Hybrid)$330k – $495k Yearly
1wOP

Software Engineer, Load Balancing - Inference

OpenAI

San Francisco, California, United States (On-site)$325k – $490k Yearly
2wCR
1wPO

Member of Engineering (Scalability)

Poolside

United Kingdom or Remote (Europe, Middle East, and Africa, North America)
4wPO

Member of Engineering (Pre-training / Data Engineering)

Poolside

United Kingdom or Remote (Europe, Middle East, and Africa + 1 more)
2wNV

Senior Software Engineer - Inference as a Service

NVIDIA

Santa Clara, California, United States (On-site)$200k – $391k Yearly
5dAN

Staff Software Engineer, Inference

Anthropic

Dublin, County Dublin, Ireland (Hybrid)€295k – €355k Yearly
3dNV

Software Engineer, Distributed Systems - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$108k – $195.5k Yearly
2wNV

Principal Software Engineer - Inference as a Service

NVIDIA

Santa Clara, California, United States (On-site)$248k – $391k Yearly
2wCR

Senior Software Engineer, Managed Services

Crusoe

San Francisco, California, United States (On-site)$166k – $201k Yearly