Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. LLM Inference

LLM Inference Jobs

Browse 29 LLM Inference jobs on Inference Jobs.

29 jobs
4w agoHippocratic AI logoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
2d agoNebius logoNE

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2K – $262.2K Yearly
Machine Learning Engineering
LLM Inference Optimization
Python
PyTorch
4d agoTogether AI logoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
TensorRT-LLM
vLLM
2d agoNebius logoNE

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2K – $262.2K Yearly
Applied Scientist
ML Research
PyTorch
Python
6d agoNVIDIA logoNV

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Engineering Management
AI Engineering
C++
Python
2w agoNVIDIA logoNV

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224K – $431.3K Yearly
Engineering Manager
LLM Performance Engineering
TensorRT-LLM
vLLM
4w agoNVIDIA logoNV

Senior Software Engineer, Deep Learning Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)$150K – $200K Yearly
Deep Learning Inference Engineering
GPU Software Development
CUDA
Triton
4w agoCartesia logoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
2w agoNVIDIA logoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
2w agoNVIDIA logoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
3w agoTogether AI logoTA

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200K – $290K Yearly
Research Engineering
ML Infrastructure Engineering
Python
Go
4w agoOpenAI logoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
4w agoPerplexity logoPE

AI Inference Engineer (London)

Perplexity

London, England, United Kingdom (On-site)
AI Inference Engineer
Machine Learning Engineer
Rust
Python
Subscribe to this search

Get email updates when new jobs match this search.

LLM Inference salary FAQs

These figures come from 3 LLM Inference jobs on Inference Jobs that include salary data. The middle 50% of advertised salaries fall between $135.9K and $322K, with the overall range spanning $151.9K – $266.3K. All figures are converted to annual USD with outliers removed. These are base salary ranges only and don't include bonuses, equity, or benefits.