Question 1

What is the average salary for LLM Inference jobs?

Accepted Answer

Based on 14 jobs with salary data, the average salary for jobs requiring LLM Inference ranges from $178.0k – $295.8k per year.

Question 2

How do LLM Inference salaries compare to the market?

Accepted Answer

Jobs requiring LLM Inference pay 5% above the average salary of $180.6k – $271.5k for all jobs listed on Inference Jobs. The median salary on Inference Jobs is $171.9k – $258.4k.

Question 3

Which companies pay the most for LLM Inference roles?

Accepted Answer

NVIDIA pays the highest average salary for LLM Inference roles at $181.3k – $318.2k, based on 9 positions.

Question 4

How are LLM Inference salaries calculated?

Accepted Answer

Salary figures are based on published job postings with salary data, normalized to annual USD equivalents. Statistical outliers are removed using interquartile range (IQR) filtering to ensure accuracy. Only positions with at least 5 data points are included.

Inference Jobs

LLM Inference Salaries

$229.8k

LLM Inference salary by seniority

Top companies for LLM Inference salaries

NVIDIA

LLM Inference salaries by location

Santa Clara

San Francisco

Related titles

Software Engineering

Hardware Engineering

DevOps

Infrastructure Engineering

Machine Learning Engineer

Software Engineer

Related skills

Python

Machine Learning

Kubernetes

C++

Data Analysis

Distributed Systems

LLM Inference salary FAQs

Inference Jobs