Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. GPU Infrastructure

GPU Infrastructure Jobs in United States

Discover GPU Infrastructure roles in United States on Inference Jobs and apply today.

3w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
2w agoNV

NVIDIA 2026 Internships: PhD Graphics and Simulation Research

NVIDIA

Santa Clara, California, United States (On-site)$30 – $94 Hourly
Research Intern
Graphics Research
Python
C
2mo agoXA

Software Engineer - Applied Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Software Engineering
Machine Learning Infrastructure
Kubernetes
SGLang
2mo agoD-

Sr. Dir, Customer Platform Engineering

d-Matrix

Santa Clara, California, United States (Hybrid)$180K – $300K Yearly
Hardware Engineering
Customer Engineering
Hardware Platform Engineering
AI Server Development
2mo agoNV

High-Performance LLM Training Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $195.5K Yearly
Machine Learning Engineer
Deep Learning Engineer
HPC
LLM Training
3mo agoMO

Member of Technical Staff - ML Performance

Modal

New York, United States (On-site)$150K – $270K Yearly
Engineering
Machine Learning Engineer
PyTorch
vLLM
1mo agoNV

Platform Software Product Manager

NVIDIA

Santa Clara, California, United States (On-site)$168K – $327.8K Yearly
Product Management
Technical Product Management
Product Management
Datacenter Products
3mo agoNV

Senior High Performance AI Engineer

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
AI Engineering
High Performance Computing
C/C++
Python
2mo agoNV

Senior Deep Learning Compiler Engineer - XLA

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
Deep Learning
C++
Compiler Optimization
3mo agoOP

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineering
Machine Learning
PyTorch
NVIDIA GPUs
2w agoNV

NVIDIA 2026 Internships: PhD Computer Architecture and Systems Research - US

NVIDIA

Santa Clara, California, United States (On-site)$30 – $94 Hourly
Internship
Research Internship
C
C++
2mo agoNV

Senior Compiler Engineer, AI Inference Platforms

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
C++
Python
1w agoGR

AI Performance Engineer

Graphcore

Milpitas, California, United States (On-site)
Performance Engineering
AI Engineering
C++
Python