Home
Jobs
Distributed Inference Serving

Distributed Inference Serving Jobs

Browse 35 Distributed Inference Serving jobs on Inference Jobs.

35 jobs

2 wk. ago

Staff Software Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Cloud Infrastructure Engineering

C++

2 wk. ago

Sr. Engineering Manager, Inference

CoreWeave

United States (Remote)$188–303K Yearly

Engineering Management

AI/ML Platform Engineering

AI/ML Platform

Inference

2 wk. ago

Site Reliability Engineer, Inference Infrastructure

Cohere

Toronto, Ontario, CA or Remote (Worldwide)

Site Reliability Engineering

MLOps

Kubernetes

Distributed Systems

2 wk. ago

Inference Engineer

Cartesia

San Francisco, California, United States (On-site)$180–250K Yearly

Inference Engineering

Machine Learning Engineering

Model Inference

Distributed Systems

2 wk. ago

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)

LLM Engineering

Machine Learning Engineering

LLM Inference

Distributed Serving

3 wk. ago

Inference Intern

Etched

San Jose, California, United States (On-site)

Inference Architecture

AI Accelerator Engineering

Python

C++

2 wk. ago

Technical Program Manager, Inference

CoreWeave

Livingston, New Jersey, United States (On-site)$198–264K Yearly

Technical Program Management

AI/ML Platform Engineering

Distributed Systems

GPU Compute

3 wk. ago

Performance Engineer, Inference Systems

Anthropic

San Francisco, California, United States (Hybrid)$350–850K Yearly

Performance Engineering

Inference Systems

Python

SQL

2 wk. ago

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, US or Remote (Canada + 3 more)

2 wk. ago

Staff Software Engineer, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)

Staff Software Engineer

Platform Engineering

C++

3 wk. ago

Software Engineer, Model Routing & Inference

Cursor

New York, United States (On-site)

2 wk. ago

Senior Inference Platform SDET

Cerebras

Sunnyvale, California, United States (On-site)

Software Development Engineer in Test

Platform Engineering

Python

2 wk. ago

Principal Engineer, Inference Cloud

Cerebras

Sunnyvale, California, United States (On-site)

Software

Cloud Computing

Distributed Systems Architecture

Cloud Infrastructure

4 wk. ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic

San Francisco, California, United States (Hybrid)$320–485K Yearly

Software Engineering - Infrastructure

Cloud Infrastructure Engineering

AWS

GCP

2 wk. ago

Staff Python / PyTorch Developer — Frontend Inference Compiler – Dubai

Cerebras

Dubai, United Arab Emirates (On-site)

Software Engineering

Machine Learning Engineering

Python

PyTorch

2 wk. ago

Lead Member of Technical Staff, Inference Infrastructure

Cohere

Worldwide (Remote)

Inference Infrastructure

Model Serving

Kubernetes

GPU Computing

2 wk. ago

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175–280K Yearly

Machine Learning Engineer

AI Engineer

PyTorch

vLLM

1 mo. ago

Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud

NVIDIA

Santa Clara, California, United States (Hybrid)$152–241.5K Yearly

Systems Software Engineering

Kubernetes Engineering

Kubernetes

Golang

1 wk. ago

Software Engineer, Monetization ML Infrastructure

OpenAI

Worldwide (Remote)$293–441K Yearly

Machine Learning Infrastructure Engineering

ML Platform Engineer

Machine Learning Infrastructure

Distributed Systems

1 mo. ago

Developer Relations Manager, Higher Education and Research - AI Agents

NVIDIA

Santa Clara, California, US or Remote (United States)$152–287.5K Yearly

Developer Relations

AI/ML Engineering

Large Language Models

PyTorch

Jobs on Inference Jobs

Browse jobs on Inference Jobs.

JobsAI-ranked

Inference Jobs

Discover the latest AI roles from Inference Jobs.

Powered byCavuno

For Candidates

Jobs
Companies

For Companies

Post a job
Pricing

Resources

Locations
Salaries
Sitemap

About

About