LLM Serving Jobs
Explore LLM Serving roles on Inference Jobs and apply today.
3mo agoCO
Senior Software Engineer II, Inference
CoreWeave
Sunnyvale, California, United States (Hybrid)$165K – $242K Yearly
4w agoLA
1mo agoNV
Research Scientist, Fundamental LLM Research for Knowledge, Reasoning, and Agents - New College Grad 2026
NVIDIA
Santa Clara, California, United States (On-site)$168K – $264.5K Yearly
4w agoNE
3mo agoCO
Member of Technical Staff, Senior/Staff MLE
Cohere
San Francisco, California, United States or Remote (California, United States + 3 more)
3mo agoOP
3mo agoLA
Deployed Engineer (Central)
LangChain
Chicago, Illinois, United States or Remote (Illinois, United States + 1 more)$150K – $270K Yearly
2mo agoNE
4w agoTA
Machine Learning Engineer
Together AI
San Francisco, California, United States (On-site)$160K – $220K Yearly
3mo agoD-
Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference
d-Matrix
Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
1mo agoNV
Senior AI Software Development Engineer, TensorRT-LLM
NVIDIA
Yokne'am, Northern District, Israel (Hybrid)
4w agoLA
Deployed Engineer (Southwest)
LangChain
San Diego, California, United States (On-site)$150K – $250K Yearly
2mo agoAN
Staff Software Engineer, Inference
Anthropic
London, England, United Kingdom (Hybrid)£325K – £390K Yearly
3mo agoCO
Member of Technical Staff, MLE
Cohere
San Francisco, California, United States or Remote (California, United States + 3 more)
3mo agoSC
Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI
Scale
San Francisco, California, United States (On-site)$252K – $315K Yearly