AI Model Inference Jobs

Machine Learning Engineer

API Design

Backend Development

4w ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly

AI Engineering

Rust

AI Infrastructure Engineer

1w ago

AI Inference Performance Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly

Performance Engineer

TensorRT-LLM

SGLang

1w ago

Manager, Large Language Model Inference

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly

Engineering Management

AI Engineering

Machine Learning Infrastructure

22h ago

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

2w ago

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly

AI Engineering

TensorRT-LLM

SGLang

2w ago

Senior Deep Learning Research Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Deep Learning Research Engineering

LLM Inference Optimization

LLM Inference Engineering

PyTorch

4w ago

D-

Principal LLM Inference Engineer

d-Matrix

United States (Remote)$195K – $285K Yearly

AI Infrastructure Engineer

Machine Learning Engineer

C/C++

22h ago

Audio Inference Engineer, Model Efficiency

Cohere

New York, US or Remote (Canada + 4 more)

AI Infrastructure

AI Accelerator Engineering

4d ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2K – $262.2K Yearly

2w ago

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly

3d ago

Inference Intern

Etched

San Jose, California, United States (On-site)

Inference Architecture

2w ago

Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles

NVIDIA

Santa Clara, California, United States (On-site)$208K – $327.8K Yearly

AI Architecture

Deep Learning Architecture

AI/ML Systems

4d ago

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius

Palo Alto, California, United States (On-site)$195.2K – $262.2K Yearly

LLM Inference Optimization

PyTorch

7d ago

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly

Machine Learning

Inference Engineering

CUDA

ML Runtimes

3w ago

Senior Software Engineer, Inference

Anthropic

Dublin, Dublin, Ireland (Hybrid)€235K – €295K Yearly

Software Engineering

Technical Program Management

Distributed Systems

Machine Learning Systems

4w ago

Technical Program Manager, Inference

CoreWeave

Livingston, New Jersey, United States (On-site)$198K – $264K Yearly

AI/ML Platform Engineering

Distributed Systems

GPU Compute

1w ago

Senior Inference Technical Product Marketing Manager - Accelerated Computing

NVIDIA

Santa Clara, California, United States (On-site)$148K – $287.5K Yearly

Technical Product Marketing

AI Product Marketing

Accelerated Computing

AI Inference

3w ago

Member of Technical Staff - RL Inference

xAI

Palo Alto, California, United States (On-site)

RL Inference Engineering

ML Infrastructure Engineering