Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Distributed Serving

Distributed Serving Jobs

Explore Distributed Serving roles on Inference Jobs and apply today.

3w agoTA

Senior Backend Engineer, Inference Platform

Together AI

San Francisco, California, United States (On-site)$160K – $250K Yearly
Backend Engineering
Platform Engineering
Rust
Go
2w agoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
3w agoET

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)
Inference Engineering
Machine Learning Infrastructure
C++
Python
2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
5d agoFI

Helix AI Engineer, Generative AI

Figure

San Jose, California, United States (On-site)
AI Engineer
Machine Learning Engineer
Generative AI
Python
6d agoTA

Director, Data Center Operations

Together AI

San Francisco, California, United States (On-site)$250K – $300K Yearly
Data Center Operations
Data Center Engineering
Data Center Power
Cooling Systems
3w agoTM

Research Engineer, Infrastructure, Numerics

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Research Infrastructure (ML Infra)
Machine Learning Infrastructure
PyTorch
JAX
3w agoTM

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Machine Learning Infrastructure
AI Infrastructure
PyTorch
JAX
2mo agoTA

Machine Learning, Platform Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $250K Yearly
Engineering
Platform Engineering
Machine Learning
Platform Engineering
2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
3w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
3mo agoCO

Audio Inference Engineer, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
AI Infrastructure
Machine Learning Engineer
C++
Python
2d agoAL

Deep Learning Engineer

AI21 Labs

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
Deep Learning
Machine Learning
Deep Learning
Large Language Models (LLMs)
4w agoMA

AI Scientist - Palo Alto

Mistral AI

Palo Alto, California, United States (Hybrid)
Research
Research Scientist
Python
Rust
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
1mo agoXA

Software Engineer, ML & Data Infra

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Machine Learning Infrastructure
Data Engineering
Python
Rust
3mo agoBA

Senior Software Engineer - Model Training

Baseten

San Francisco, California, United States (On-site)$200K – $275K Yearly
Engineering
Model Training
ML Infrastructure
Model Training