AI Model Inference Jobs

Deep Learning Engineering

Python

Rust

3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly

Inference Engineering

AI Infrastructure

Inference

GPU Computing

1mo agoNV

Inference Optimization Architect, Speech AI

NVIDIA

Pune, Maharashtra, India (On-site)

AI Infrastructure

Inference Optimization

Speech AI

4w agoCE

Inference Core Platform Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

Platform Engineering

Python

C++

5d agoNV

Inference Optimization Architect, Speech AI

NVIDIA

Bengaluru, Karnataka, India (On-site)

Machine Learning Infrastructure

Deep Learning Engineer

CUDA

TensorRT

1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

2mo agoNE

Chief ML Researcher, Product

Nebius

United States (Remote)$200K – $300K Yearly

Machine Learning Research

Technical Program Management

3mo agoOP

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly

3w agoXT

AI in Residence

Xaira Therapeutics

South San Francisco, California, United States (On-site)$10K – $15K Monthly

2w agoGR

Distinguished Engineer - Inference Serving Network and Storage

Graphcore

Austin, Texas, United States (On-site)

3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

2mo agoAN

Technical Program Manager, Inference Performance

Anthropic

San Francisco, California, United States (Hybrid)$290K – $365K Yearly

Technical Program Manager

Technical Program Management

Inference Systems

2mo agoNV

Principal Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$272K – $431.3K Yearly

3mo agoCR

Staff Product Manager, Managed Inference (SF/Sunnyvale/New York)

Crusoe

San Francisco, California, United States or Remote (California, United States + 1 more)$204K – $247K Yearly

Product Management

Technical Product Management

Cloud Infrastructure

AWS

3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly

Machine Learning Intern

Large Language Models (LLM)

4w agoOP

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly

Inference Engineering

CUDA

ML Runtimes

6d agoCE

ML Research Engineer (Inference)

Cerebras

Bengaluru, Karnataka, India (On-site)

AI Research & Engineering

Python

PyTorch

2w agoAN

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly

Engineering Management

4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly