Inference Engineering Jobs in San Francisco, California, United States

3w ago

Forward Deployed Engineer (Inference & Post-Training)

Together AI

San Francisco, California, United States (On-site)$270K – $300K Yearly

Inference Engineering

AI/ML Engineering

vLLM

TensorRT-LLM

1w ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly

Performance Engineering

Inference Systems

SQL

5d ago

Software Engineer, Model Inference

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

5d ago

Software Engineer, Inference - Performance Optimization

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

Scaling

Inference

Performance Profiling

Benchmarking

2w ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly

AI Research Engineer

LLM Inference

TensorRT-LLM

5d ago

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly

Inference Engineering

AI Infrastructure

GPU Inference

Model Serving

3d ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly

AI Engineering

Rust

AI Research & Engineering

2w ago

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly

Software Engineering - Infrastructure

Machine Learning

2w ago

Senior/Staff Software Engineer, Inference

Anthropic

San Francisco, California, United States (Hybrid)$300K – $485K Yearly

Software Engineering

Machine Learning Systems

2w ago

Engineering Manager, Inference Routing and Performance

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly

Infrastructure Engineering

Machine Learning Infrastructure

Inference Routing

5d ago

Software Engineer, Inference - Multi Modal

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

Software Engineer

Inference Engineer

Inference Infrastructure

Multimodal Models

2w ago

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly

AI Infrastructure

PyTorch

JAX

2w ago

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly

Research Engineering

Machine Learning Infrastructure

High-Performance Inference

Model Execution

2w ago

Engineering Manager, Cloud Inference AWS

Anthropic

San Francisco, California, United States (Hybrid)$405K – $485K Yearly

Cloud Engineering

AWS

Cloud Inference

5d ago

Applied AI Inference Engineer

Baseten

San Francisco, California, US or Remote (California, United States + 1 more)$165K – $330K Yearly

Applied AI Engineering

Docker

3d ago

Inference Engineering Manager

Perplexity

San Francisco, California, United States (On-site)$300K – $485K Yearly

PyTorch

2w ago

Member of Technical Staff, Inference & RL Systems

Magic

San Francisco, California, United States (On-site)$225K – $550K Yearly

Software Engineer

Reinforcement Learning

5d ago

Solution Architect (AI/LLM Inference)

Baseten

Worldwide (Remote)$165K – $330K Yearly

Solution Architecture

AI/ML Sales Engineering

AI/ML

5d ago

Audio Inference Engineer, Model Efficiency

Cohere

New York, US or Remote (Canada + 4 more)

AI Infrastructure

C++