Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. LLM Serving Frameworks

LLM Serving Frameworks Jobs

Explore LLM Serving Frameworks roles on Inference Jobs and apply today.

1mo agoTA

Engineering Manager, Model Serving

Together AI

San Francisco, California, United States (On-site)$250K – $300K Yearly
Engineering Manager
Machine Learning Engineering
Kubernetes
Multi-cluster Orchestration
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
3w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3w agoSC

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$179.4K – $224.3K Yearly
ML Infrastructure
Machine Learning Engineer
Python
Go
3d agoAN

Startups Solutions Architect, Applied AI

Anthropic

San Francisco, California, United States (Hybrid)$190K – $315K Yearly
Sales Engineering
Solutions Architecture
Python
LLM Frameworks
3mo agoAN

Solutions Architect, Beneficial Deployments

Anthropic

San Francisco, California, United States (Hybrid)$240K – $270K Yearly
Solutions Architecture
Sales Engineering
Solutions Architecture
Prompt Engineering
2d agoNV

Senior Software Engineer, AI Inference

NVIDIA

Toronto, Ontario, Canada (Hybrid)C$135K – C$220K Yearly
Software Engineering
AI/ML Engineering
LLM Serving
vLLM
1w agoAN

Forward Deployed Engineer

Anthropic

Atlanta, Georgia, United States (Hybrid)$200K – $300K Yearly
Forward Deployed Engineer
Sales Engineering
LLMs
Prompt Engineering
2mo agoHA

Mid/Senior/Staff Software Engineer, Agents

Harvey

San Francisco, California, United States (On-site)$165K – $312K Yearly
Software Engineering
AI Engineering
Python
LLM APIs
1w agoAN

Solutions Architect, Applied AI

Anthropic

San Francisco, California, United States (Hybrid)$240K – $315K Yearly
Solutions Architecture
Sales Engineering
Solutions Architecture
Python
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
1mo agoNV

Senior Deep Learning Algorithm Engineer, Training Framework

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $287.5K Yearly
Deep Learning
AI Infrastructure
Megatron Core
NeMo Framework
3mo agoBA

Software Engineer - Model API's

Baseten

San Francisco, California, United States (On-site)$150K – $230K Yearly
Engineering
Software Engineering
TensorRT-LLM
CUDA
4w agoZU

Staff Engineer (Agentic AI & Data)

Zuma

San Francisco, California, United States (Hybrid)
Staff Engineer
AI Engineering
Agentic AI
LLMs