LLM Serving Jobs
Explore LLM Serving roles on Inference Jobs and apply today.
2mo agoSC
Staff Machine Learning Research Scientist, LLM Evals
Scale
San Francisco, California, United States (On-site)$280K – $380K Yearly
3mo agoCO
Senior Software Engineer I, Inference
CoreWeave
Sunnyvale, California, United States (Hybrid)$139K – $204K Yearly
2mo agoNV
High-Performance LLM Training Engineer - New College Grad 2026
NVIDIA
Santa Clara, California, United States (On-site)$124K – $195.5K Yearly
4w agoTA
LLM Inference Frameworks and Optimization Engineer
Together AI
San Francisco, California, United States (On-site)$160K – $230K Yearly
2mo agoCE
2mo agoSC
Senior/Staff Machine Learning Engineer, General Agents, Enterprise GenAI
Scale
San Francisco, California, US$218K – $273K Yearly
4w agoBA
7d agoAN
Staff+ Software Engineer, Platform
Anthropic
San Francisco, California, United States (Hybrid)$405K – $485K Yearly
2w agoTA
Senior Machine Learning Engineer, Voice AI
Together AI
San Francisco, California, United States (On-site)$200K – $260K Yearly
3mo agoBA
Software Engineer - Model Performance
Baseten
San Francisco, California, United States (On-site)$150K – $250K Yearly
5d agoAN
Startups Solutions Architect, Applied AI
Anthropic
San Francisco, California, United States (Hybrid)$190K – $315K Yearly
3mo agoCO
Senior Research Scientist, Model Evaluation
Cohere
Toronto, Ontario, Canada or Remote (Canada + 2 more)