Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Low-latency Retrieval

Low-latency Retrieval Jobs

Explore Low-latency Retrieval roles on Inference Jobs and apply today.

3w agoSC

AI Infrastructure Engineer, Model Serving Platform

Scale

San Francisco, California, United States (On-site)$179.4K – $224.3K Yearly
ML Infrastructure
Machine Learning Engineer
Python
Go
2w agoAN

Research Engineer, Performance RL

Anthropic

San Francisco, California, United States (Hybrid)$350K – $850K Yearly
AI Research & Engineering
Machine Learning Engineer
Reinforcement Learning
CUDA
2w agoTM

Research Engineer, Infrastructure, RL Systems

Thinking Machines Lab

San Francisco, California, United States (On-site)$350K – $475K Yearly
Machine Learning Infrastructure
Research Engineering
Reinforcement Learning
Distributed Training
3w agoSC

Machine Learning Research Scientist / Research Engineer, Post-Training

Scale

San Francisco, California, United States (On-site)$252K – $315K Yearly
Research Scientist
Research Engineer
LLMs
Post-Training
3w agoSC

ML Research Engineer, ML Systems

Scale

San Francisco, California, United States (On-site)$218.4K – $273K Yearly
Machine Learning Engineer
ML Research
CUDA
PyTorch
6d agoAN

Research Engineer, Machine Learning (Horizons)

Anthropic

San Francisco, California, United States (Hybrid)$500K – $850K Yearly
Machine Learning Engineering
AI Research
Python
Reinforcement Learning
1mo agoNV

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $241.5K Yearly
AI Engineering
Machine Learning Infrastructure
TensorRT-LLM
SGLang
3w agoNV

Deep Learning Engineer - LLM and VLM Model Compression

NVIDIA

Warszawa, Masovian Voivodeship, Poland (On-site)zł 292.5K – zł 650K Yearly
Deep Learning
Machine Learning Engineering
Deep Learning
Large Language Models
1mo agoNV

Senior Software Engineer, Quantized Inference

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly
Software Engineering
Machine Learning Engineer
Python
C++
1w agoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
3w agoVA

AI Agent Researcher

Vast.ai

San Francisco, California, United States (On-site)$160K – $320K Yearly
AI Researcher
Machine Learning Researcher
Python
C++
3w agoSC

Machine Learning Research Scientist/ Engineer, Agents

Scale

San Francisco, California, United States (On-site)$275K – $350K Yearly
Machine Learning Research
Machine Learning Engineer
LLMs
PyTorch
19h agoNV

Senior Product Manager, AI Inference - Dynamo

NVIDIA

Santa Clara, California, United States (On-site)$208K – $327.8K Yearly
AI Product Management
Technical Product Management
Product Management
AI Inference
6d agoAN

Research Engineer, Pretraining Scaling (London)

Anthropic

London, England, United Kingdom (On-site)£260K – £630K Yearly
AI Research & Engineering
Machine Learning Engineer
JAX
TPU