Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. LLM Inference Engineering

LLM Inference Engineering Jobs

Browse 24 LLM Inference Engineering jobs on Inference Jobs.

24 jobs
3w agoHippocratic AI logoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
14h agoTogether AI logoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
TensorRT-LLM
vLLM
2w agoTogether AI logoTA

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200K – $290K Yearly
Research Engineering
ML Infrastructure Engineering
Python
Go
1w agoNVIDIA logoNV

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224K – $431.3K Yearly
Engineering Manager
LLM Performance Engineering
TensorRT-LLM
vLLM
2d agoNVIDIA logoNV

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Engineering Management
AI Engineering
C++
Python
3w agoNVIDIA logoNV

Senior Software Engineer, Deep Learning Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)$150K – $200K Yearly
Deep Learning Inference Engineering
GPU Software Development
CUDA
Triton
4w agoBaseten logoBA

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260K – $380K Yearly
Engineering Management
Forward Deployed Engineering
Python
LLMs
1w agoNVIDIA logoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
1w agoNVIDIA logoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
4w agoCartesia logoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
4w agoOpenAI logoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
4w agoPerplexity logoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly
AI Engineering
Machine Learning Engineer
Rust
Python
Subscribe to this search

Get email updates when new jobs match this search.

LLM Inference Engineering salary FAQs

These figures come from 4 LLM Inference Engineering jobs on Inference Jobs that include salary data. The middle 50% of advertised salaries fall between $166K and $360K, with the overall range spanning $169.8K – $311.6K. All figures are converted to annual USD with outliers removed. These are base salary ranges only and don't include bonuses, equity, or benefits.