Private Inference Jobs

LLM Engineering

Software Engineering - Infrastructure

C++

2w ago

Deployment Engineer, AI Inference

Cerebras

Sunnyvale, California, United States (On-site)

2w ago

Staff + Senior Software Engineer, Cloud Inference

Anthropic

San Francisco, California, United States (Hybrid)$300K – $485K Yearly

Cloud Infrastructure

AWS

GCP

4w ago

Generative AI Inference Engineer

Stability AI

Worldwide (Remote)

Machine Learning Engineering

Generative AI Engineering

PyTorch

2w ago

Engineering Manager, Inference Routing and Performance

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly

Infrastructure Engineering

Distributed Systems

Inference Routing

5d ago

Researcher, Safety & Privacy

OpenAI

San Francisco, California, United States (On-site)$295K – $445K Yearly

Safety Systems

AI Safety

Privacy-Preserving Computation

Secure Enclaves

5d ago

Applied AI Inference Engineer

Baseten

San Francisco, California, US or Remote (California, United States + 1 more)$165K – $330K Yearly

Applied AI Engineering

Docker

2w ago

Member of Technical Staff, Inference & RL Systems

Magic

San Francisco, California, United States (On-site)$225K – $550K Yearly

Software Engineer

Distributed Systems

Reinforcement Learning

3w ago

Staff+ Software Engineer, Privacy

Anthropic

San Francisco, California, United States (Hybrid)$405K – $625K Yearly

5d ago

Audio Inference Engineer, Model Efficiency

Cohere

New York, US or Remote (Canada + 4 more)

AI Infrastructure

C++

2w ago

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly

Machine Learning

Inference Engineering

CUDA

ML Runtimes

2d ago

Engineering Manager, Inference Benchmarking — AI Perf

NVIDIA

United States (Remote)$224K – $356.5K Yearly

Performance Engineering

LLM Inference

vLLM

2w ago

Software Engineer, Cloud Inference Safeguards

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly

2w ago

Member of Technical Staff, Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly

AI Infrastructure

Rust

2w ago

Engineering Manager, Inference ML Runtime

Cerebras

Sunnyvale, California, United States (On-site)

Machine Learning Engineering

AI Research & Engineering

C++

2w ago

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly

Compiler Engineering

AI Engineering

Compiler Technologies

MLIR

2w ago

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly

Software Engineering - Infrastructure

Machine Learning

3w ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320K – $485K Yearly

Cloud Infrastructure Engineering

LLM Serving

Distributed Systems

2w ago

Technical Program Manager, Inference Performance

Anthropic

San Francisco, California, United States (Hybrid)$290K – $365K Yearly

Technical Program Management

Technical Program Manager

Technical Program Management

Inference Systems

1w ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (Hybrid)

Performance Engineering

LLM Inference