Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Inference Frameworks

Inference Frameworks Jobs

Explore Inference Frameworks roles on Inference Jobs and apply today.

3w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
2mo agoCE

Inference Frontend

Cerebras

Sunnyvale, California, United States (On-site)
Software Engineering
Artificial Intelligence
C++
Compilers
1w agoAN

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly
AI Research & Engineering
Engineering Management
Machine Learning
AI
3w agoET

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)
Inference Engineering
Machine Learning Infrastructure
C++
Python
2mo agoXA

Member of Technical Staff, Model Evaluation

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Machine Learning Engineer
Model Evaluation
Python
JAX
3mo agoCA

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly
Inference Engineering
Machine Learning Engineering
Model Inference
Distributed Systems
3mo agoPE

Inference Engineering Manager

Perplexity

San Francisco, California, United States (On-site)$300K – $385K Yearly
AI
Engineering Management
Python
PyTorch
3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
Inference
GPU Computing
3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust
3mo agoOP

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference Engineer
Inference Infrastructure
Multimodal Models
2mo agoNV

Senior ML Framework Performance Engineer - AI for Science at Scale

NVIDIA

Santa Clara, California, United States (On-site)$184K – $287.5K Yearly
Machine Learning Engineer
Performance Engineer
PyTorch
JAX
3w agoOP

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly
Machine Learning
Inference Engineering
CUDA
ML Runtimes
3w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang