Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Distributed Serving

Distributed Serving Jobs

Explore Distributed Serving roles on Inference Jobs and apply today.

2w agoAI

Software Engineer - Insights Platform

Applied Intuition

Sunnyvale, California, United States (On-site)$125K – $222K Yearly
Software Engineering
Data Engineering
Data Infrastructure
Platform Engineering
3mo agoBA

Software Engineer - Model Performance

Baseten

San Francisco, California, United States (On-site)$150K – $250K Yearly
Engineering
Model Performance
LLM Inference
TensorRT
3mo agoOP

Software Engineer, Hardware

OpenAI

San Francisco, California, United States (Hybrid)$310K – $460K Yearly
Software Engineering
Scaling
Rust
Python
3w agoOP

Senior Software Engineer, Product

OpenAI

Bellevue, Washington, United States (Hybrid)$293K – $324K Yearly
Software Engineering
Platform Engineering
Experimentation
Feature Flagging
3mo agoDE

Staff Software Engineer, Voice Agent

Decagon

San Francisco, California, United States (On-site)$300K – $375K Yearly
Software Engineering
Staff Engineer
Real-time Systems
Streaming Pipelines
2mo agoNE

HPC Specialist Solutions Architect

Nebius

United States + 1 more (Remote)$225K – $315K Yearly
Solutions Architecture
HPC Engineering
HPC
Kubernetes
1mo agoNV

Senior GPU System Architect

NVIDIA

Bengaluru, Karnataka, India (On-site)
GPU Architecture
System Architecture
NVLink
Ethernet
3mo agoCR

Senior to Senior Staff Solutions Engineer

Crusoe

San Francisco, California, United States (On-site)$175K – $250K Yearly
Solutions Engineering
MLOps
Kubernetes
MLOps
1mo agoNV

Senior Performance Engineer - Deep Learning

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Software Engineering
Deep Learning
C++
Python
3mo agoCA

Senior Applied Researcher, Audio Understanding

Cartesia

San Francisco, California, United States (On-site)$200K – $350K Yearly
Applied Research
Machine Learning Research
State Space Models
SSM
3d agoCO

Software Engineer, Observability

CoreWeave

Livingston, New Jersey, United States (Hybrid)$109K – $145K Yearly
Software Engineering
DevOps
Software Engineering
Site Reliability Engineering
2mo agoNV

Senior Solutions Architect, Networking - Hyperscale

NVIDIA

Santa Clara, California, United States (On-site)$224K – $431.3K Yearly
Solutions Architecture
Networking
Networking
Solutions Architecture
2mo agoNV

Manager, Next-Gen AI Cluster Validation

NVIDIA

Santa Clara, California, United States (Hybrid)$224K – $356.5K Yearly
AI Engineering
High-Performance Computing (HPC)
High-Performance Computing
Machine Learning