Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. LLM Inference Engineering

LLM Inference Engineering Jobs

Browse 26 LLM Inference Engineering jobs on Inference Jobs.

26 jobs
2w agoHippocratic AI logoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
2d agoNVIDIA logoNV

Senior Inference Engineer, AIConfigurator for Dynamo

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Inference Engineer
AI/LLM Deployment
Python
Rust
1w agoTogether AI logoTA

Research Engineer, Post-Training Inference

Together AI

San Francisco, California, United States (On-site)$200K – $290K Yearly
Research Engineering
ML Infrastructure Engineering
Python
Go
3w agoTogether AI logoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
TensorRT-LLM
vLLM
3d agoNVIDIA logoNV

Engineering Manager, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$224K – $431.3K Yearly
Engineering Manager
LLM Performance Engineering
TensorRT-LLM
vLLM
3w agoBaseten logoBA

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260K – $380K Yearly
Engineering Management
Forward Deployed Engineering
Python
LLMs
2w agoNVIDIA logoNV

Senior Software Engineer, Deep Learning Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)$150K – $200K Yearly
Deep Learning Inference Engineering
GPU Software Development
CUDA
Triton
2w agoCartesia logoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
3d agoNVIDIA logoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
2d agoNVIDIA logoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
2w agoReflection AI logoRA

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)
Forward Deployed Engineer
ML Engineer
Python
Fine-tuning
3d agoSambaNova logoSA

Senior Software Engineer, ML Infrastructure

SambaNova

United States (Remote)$200K – $275K Yearly
Software Engineering
ML Infrastructure
Python
vLLM
Subscribe to this search

Get email updates when new jobs match this search.

LLM Inference Engineering salary FAQs

These figures come from 4 LLM Inference Engineering jobs on Inference Jobs that include salary data. The middle 50% of advertised salaries fall between $166K and $360K, with the overall range spanning $169.8K – $311.6K. All figures are converted to annual USD with outliers removed. These are base salary ranges only and don't include bonuses, equity, or benefits.