Distributed Inference Jobs

ML Infrastructure Engineering

2w ago

Senior Backend Engineer, Inference Platform

Together AI

San Francisco, California, United States (On-site)$160K – $250K Yearly

Backend Engineering

Platform Engineering

Rust

2d ago

Member of Technical Staff - Mid-Training Infra

Reflection AI

San Francisco, California, United States (On-site)

GPU Systems Engineering

GPU Infrastructure

Model Inference

5d ago

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, US or Remote (Canada + 3 more)

2w ago

Senior Deep Learning Solution Architect

NVIDIA

Beijing, Beijing, China (On-site)

Deep Learning

Solution Architecture

Deep Learning

LLM Inference

2w ago

Senior DL Algorithms Engineer - Inference Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly

Deep Learning Engineer

Algorithms Engineer

Deep Learning

Inference

2w ago

Inference Core Platform Benchmarking Engineer

Cerebras

Toronto, Ontario, Canada (Hybrid)

Performance Engineering

Platform Engineering

C++

2w ago

Member of Technical Staff, Inference

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly

AI Infrastructure

Technical Program Management

Rust

2w ago

Technical Program Manager, Inference Performance

Anthropic

San Francisco, California, United States (Hybrid)$290K – $365K Yearly

Technical Program Manager

Technical Program Management

Inference Systems

2w ago

Solutions Architect - Top AI Labs

NVIDIA

Beijing, Beijing, China (On-site)

Solutions Architecture

AI Engineering

LLM Inference

vLLM

2w ago

ML Research Engineer (Inference)

Cerebras

Bengaluru, Karnataka, India (On-site)

AI Research

Software Engineering Internship

3w ago

Solutions Architect, Cloud Inference Services

NVIDIA

Zürich, Switzerland (On-site)

Solutions Architecture

Cloud Architecture

Neural Network Inference

Agentic Pipelines

2w ago

UK Internship Program

Perplexity

London, England, United Kingdom (Hybrid)

AI Inference

GPU Programming

2w ago

Distributed Training Engineer

Periodic Labs

Menlo Park, California, United States (On-site)

Machine Learning Infrastructure

Distributed Systems Engineering

Distributed LLM Training

Distributed Systems

5d ago

Distributed Training Engineer, Sora

OpenAI

San Francisco, California, United States (Hybrid)$293K – $490K Yearly

AI Research & Engineering

Distributed Systems

2w ago

Engineering Manager, Inference

Anthropic

San Francisco, California, United States (Hybrid)$425K – $560K Yearly

Engineering Management

Machine Learning

2w ago

Machine Learning Engineer - Inference

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly

Inference Engineer

2w ago

Senior HPC and AI Network Software Architect

NVIDIA

Zürich, Switzerland (On-site)

Software Architecture

HPC Software Development

C++

2w ago

ML Research Engineer, ML Systems

Scale

San Francisco, California, United States (On-site)$218.4K – $273K Yearly

ML Research

CUDA