Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Inference Software Development

Inference Software Development Jobs

Explore Inference Software Development roles on Inference Jobs and apply today.

19h agoNV

Software Engineer, Machine Learning Inference - New College Grad 2026

NVIDIA

Santa Clara, California, United States (Hybrid)$108K – $195.5K Yearly
Machine Learning Engineering
Software Engineering
C++
Python
3w agoTM

Research Engineer, Infrastructure, Inference

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Machine Learning Infrastructure
AI Infrastructure
PyTorch
JAX
2mo agoAN

Software Engineer, Inference Deployment

Anthropic

San Francisco, California, United States (Hybrid)$320K – $485K Yearly
Software Engineering
Infrastructure Engineering
Kubernetes
Python
4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
1mo agoAN

Sr. Software Engineer, Inference

Anthropic

London, England, United Kingdom (Hybrid)£225K – £325K Yearly
Software Engineering
Infrastructure Engineering
Distributed Systems
Machine Learning Systems
19h agoNV

Senior Software Engineer - AI Inference

NVIDIA

Santa Clara, California, United States (On-site)$152K – $287.5K Yearly
AI Inference Engineering
LLM Serving Engineering
vLLM
SGLang
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
3mo agoOP

Software Engineer, Inference – AMD GPU Enablement

OpenAI

San Francisco, California, United States (On-site)$325K – $490K Yearly
Software Engineer
Inference
HIP
CUDA
2mo agoCO

Software Engineer, Inference AI/ML

CoreWeave

Sunnyvale, California, United States (Hybrid)$92K – $135K Yearly
Software Engineering
Machine Learning Engineering
Python
Go
2d agoCE

Engineering Lead, Inference Platform

Cerebras

Sunnyvale, California, United States (On-site)
Platform Engineering
Backend Engineering
Go
C++
4w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
2mo agoNV

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Senior Software Engineer
AI Inference
Python
C/C++
3mo agoPE

Inference Engineering Manager

Perplexity

San Francisco, California, United States (On-site)$300K – $385K Yearly
AI
Engineering Management
Python
PyTorch
3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
Inference
GPU Computing
2mo agoAN

Staff + Senior Software Engineer, Cloud Inference

Anthropic

San Francisco, California, United States (Hybrid)$300K – $485K Yearly
Software Engineering - Infrastructure
Cloud Infrastructure
AWS
GCP