Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. California
  5. Santa Clara
  6. AI Inference Engineering

AI Inference Engineering Jobs in Santa Clara, California, United States

Discover AI Inference Engineering roles in Santa Clara, California, United States on Inference Jobs and apply today.

2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI Engineering
LLM Inference
vLLM
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
2mo agoNV

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
Compiler Technologies
MLIR
2mo agoNV

Senior Compiler Engineer, AI Inference Platforms

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
C++
Python
1mo agoNV

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
Deep Learning Engineer
Algorithms Engineer
Deep Learning
Inference
2mo agoNV

Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Software Engineering
Machine Learning Engineering
Deep Learning
C++
3mo agoCO

Audio Inference Engineer, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
AI Infrastructure
Machine Learning Engineer
C++
Python
2mo agoNV

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Senior Software Engineer
AI Inference
Python
C/C++
18h agoNV

Senior Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly
AI Inference Engineering
LLM Serving Engineering
vLLM
SGLang
2mo agoNV

Senior Compiler Engineer, AI Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Compiler Engineering
Compiler Engineering
Deep Learning
3mo agoCR

Staff Product Manager, Managed Inference (SF/Sunnyvale/New York)

Crusoe

San Francisco, California, United States or Remote (California, United States + 1 more)$204K – $247K Yearly
Product Management
Technical Product Management
Cloud Infrastructure
AWS
18h agoNV

Software Engineer, Machine Learning Inference - New College Grad 2026

NVIDIA

Santa Clara, California, United States (Hybrid)$108K – $195.5K Yearly
Machine Learning Engineering
Software Engineering
C++
Python
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
3mo agoCO

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, United States or Remote (United States + 2 more)
Inference
Model Serving
Kubernetes
Distributed Systems
2mo agoNV

Senior Deep Learning Engineer - Model Evaluation & AI Systems

NVIDIA

Santa Clara, California, United States (On-site)$224K – $431.3K Yearly
Deep Learning
AI Engineering
Deep Learning
Model Evaluation
2mo agoNV

Senior ML Framework Performance Engineer - AI for Science at Scale

NVIDIA

Santa Clara, California, United States (On-site)$184K – $287.5K Yearly
Machine Learning Engineer
Performance Engineer
PyTorch
JAX
2mo agoNV

Lead Principal Engineer, Enterprise Agentic AI Platform

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly
Software Engineering
AI/ML Engineering
Python
Go
1mo agoNE

Senior Sales Engineer

Nebius

United States (Remote)$152K – $228K Yearly
Sales Engineering
Solutions Engineering
AI Inference
GPU Computing