LLM Serving Jobs
Browse 299 LLM Serving jobs on Inference Jobs.
299 jobs
2wBA
Engineering Manager - Forward Deployed Engineering (LLM)
Baseten
San Francisco, California, United States (On-site)$220k – $285k Yearly
2wSE
ML Model Serving Engineer
Sesame
San Francisco, California, United States (On-site)$175k – $280k Yearly
5dCO
Director of Engineering, Inference Services
CoreWeave
Sunnyvale, California, United States (Hybrid)$206k – $303k Yearly
6dSC
AI Infrastructure Engineer, Model Serving Platform
Scale
San Francisco, California, United States (On-site)$179.4k – $224.3k Yearly
2wBA
Technical Enablement Lead
Baseten
San Francisco, California, United States (On-site)$175k – $210k Yearly
2wAN
Software Engineer, AI Reliability
Anthropic
San Francisco, California, United States (Hybrid)$325k – $485k Yearly
2wNV
6dXA
Member of Technical Staff - Reasoning Efficiency
xAI
Palo Alto, California, United States (On-site)$180k – $440k Yearly
2wRA
Member of Technical Staff - Data Quality Engineer (Post-training)
Reflection AI
San Francisco, California, United States (On-site)
2wSC
Tech Lead Manager, Machine Learning Research Scientist- LLM Evals
Scale
San Francisco, California, United States (On-site)$280k – $380k Yearly
5dNV
Senior Research Scientist, Fundamental LLM Research for Knowledge, Reasoning, and Agents
NVIDIA
Santa Clara, California, United States (On-site)$224k – $356.5k Yearly
2wCO
Member of Technical Staff, Model Efficiency
Cohere
New York, New York, United States or Remote (New York, United States + 3 more)
1wD-
Senior Staff ML Researcher - LLM Algorithmic Optimization
d-Matrix
Bengaluru, Karnataka, India (Hybrid)₹4M – ₹6M Yearly
2wNV
High-Performance LLM Training Engineer - New College Grad 2026
NVIDIA
Santa Clara, California, United States (On-site)$124k – $195.5k Yearly