Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. LLM Serving

LLM Serving Jobs

Explore LLM Serving roles on Inference Jobs and apply today.

3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
4w agoSC

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$179.4K – $224.3K Yearly
ML Infrastructure
Machine Learning Engineer
Python
Go
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
1mo agoTA

Engineering Manager, Model Serving

Together AI

San Francisco, California, United States (On-site)$250K – $300K Yearly
Engineering Manager
Machine Learning Engineering
Kubernetes
Multi-cluster Orchestration
3mo agoBA

Software Engineer - Model API's

Baseten

San Francisco, California, United States (On-site)$150K – $230K Yearly
Engineering
Software Engineering
TensorRT-LLM
CUDA
3mo agoCO

Member of Technical Staff, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
Modeling
Machine Learning Engineer
C++
Python
4w agoCR

Principal Engineer, AI Model LifeCycle

Crusoe

San Francisco, California, United States (On-site)$260K – $326K Yearly
Principal Engineer
AI Infrastructure Engineer
Large Language Models (LLMs)
Generative AI
2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
446 LLM Serving jobs | Inference Jobs