Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. Real-time Inference Serving

Real-time Inference Serving Jobs

Browse 56 Real-time Inference Serving jobs on Inference Jobs.

56 jobs
5d agoCartesia logoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
1w agoOpenAI logoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
GPU Inference
Model Serving
3d agoHippocratic AI logoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
1w agoOpenAI logoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
4w agoCoreWeave logoCO

Staff Software Engineer, Inference

CoreWeave

Sunnyvale, California, United States (Hybrid)$188K – $275K Yearly
Staff Software Engineer
Inference Engineering
Go
Python
5d agoSesame logoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
PyTorch
VLLM
3w agoOpenAI logoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
5d agoPerplexity logoPE

AI Inference Engineer (London)

Perplexity

London, England, United Kingdom (On-site)
AI Inference Engineer
Machine Learning Engineer
Rust
Python
1w agoOpenAI logoOP

Software Engineer, Inference - Performance Optimization

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Scaling
Inference
Performance Profiling
Benchmarking
3w agoCerebras logoCE

Engineering Lead, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)
Platform Engineering
Backend Engineering
Go
C++
4d agoCerebras logoCE

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
AI Engineer
Python
C++
1w agoOpenAI logoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Software Engineer
Inference
HIP
CUDA
2w agoAnthropic logoAN

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly
Performance Engineering
Inference Systems
Python
SQL
5d agoPerplexity logoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly
AI Engineering
Machine Learning Engineer
Rust
Python
3w agoTogether AI logoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
3w agoTogether AI logoTA

Forward Deployed Engineer (Inference & Post-Training)

Together AI

San Francisco, California, United States (On-site)$270K – $300K Yearly
Inference Engineering
AI/ML Engineering
vLLM
TensorRT-LLM
3w agoEtched logoET

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)
Inference Engineering
Machine Learning Infrastructure
C++
Python
Subscribe to this search

Get email updates when new jobs match this search.