Inference Runtimes Jobs

Machine Learning Infrastructure

2w ago

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly

Research Engineering

High-Performance Inference

Model Execution

3d ago

AI Inference Engineer (London)

Perplexity

London, England, United Kingdom (On-site)

AI Inference Engineer

Rust

2w ago

Performance Engineer - Inference

Cerebras

Sunnyvale, California, United States (On-site)

Performance Engineering

Software Engineering

Computer Architecture

Deep Learning

4d ago

Software Engineer, Productivity - Inference Runtime

OpenAI

San Francisco, California, United States (On-site)$230K – $385K Yearly

Developer Productivity

CI/CD Infrastructure

3d ago

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$220K – $485K Yearly

AI Engineering

Rust

1w ago

Python / PyTorch Developer — Frontend Inference Compiler – Dubai

Cerebras

AE or Remote (Europe, Middle East, and Africa + 2 more)

Compiler Engineer

PyTorch

2w ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly

AI Research Engineer

LLM Inference

TensorRT-LLM

1d ago

Sr. MTS - Inference ML Eng

Cerebras

Sunnyvale, California, United States (On-site)

AI Engineer

2w ago

Inference Core Platform Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

Platform Engineering

Machine Learning Infrastructure

2w ago

Inference Technical Lead, On-Device Transformers

OpenAI

San Francisco, California, United States (Hybrid)$445K – $445K Yearly

Machine Learning

Inference Engineering

CUDA

ML Runtimes

2w ago

Inference Software Engineer

Etched

Cupertino, California, United States (On-site)

Inference Engineering

Machine Learning Engineering

4d ago

Software Engineer, Inference - Performance Optimization

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

Scaling

Inference

Performance Profiling

Benchmarking

2d ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180K – $250K Yearly

Inference Engineering

Model Inference

Distributed Systems

4d ago

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$295K – $555K Yearly

3w ago

Senior Deep Learning Research Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Deep Learning Research Engineering

LLM Inference Optimization

ML Infrastructure Engineering

PyTorch

2w ago

Senior Runtime Engineer

Cerebras

Sunnyvale, California, United States (On-site)

4d ago

Software Engineer - Voice AI (Inference Runtime)

Baseten

United States (Remote)$165K – $330K Yearly

Voice AI Engineering