Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. Latency Optimization

Latency Optimization Jobs

Explore Latency Optimization roles on Inference Jobs and apply today.

2mo agoNV

Senior AI Inference Compiler Engineer

NVIDIA

Santa Clara, California, United States (On-site)$152K – $241.5K Yearly
Compiler Engineering
AI Engineering
Compiler Technologies
MLIR
3w agoET

Machine Learning Research Engineer

Etched

Cupertino, California, United States (On-site)
Machine Learning Engineer
AI Research Scientist
Python
Rust
4w agoCE

Full Stack LLM Engineer

Cerebras

Toronto, Ontario, Canada (On-site)
Machine Learning Engineer
AI Engineering
Python
PyTorch
1mo agoNV

Senior LLVM Compiler Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)
Compiler Engineering
GPU Computing
LLVM
GCC
3mo agoPE

AI Inference Engineer (San Francisco)

Perplexity

San Francisco, California, United States (On-site)$210K – $385K Yearly
AI Engineering
Machine Learning Engineer
Python
Rust
3w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
2mo agoNV

Senior Software Engineer, Quantized Inference

NVIDIA

Redmond, Washington, United States (On-site)$152K – $287.5K Yearly
Software Engineering
Machine Learning Engineer
Python
C++
3mo agoOP

Inference Technical Lead, Sora

OpenAI

San Francisco, California, United States (Hybrid)$380K – $380K Yearly
Inference Engineering
AI Infrastructure
Inference
GPU Computing
4w agoCE

Performance Engineer

Cerebras

Toronto, Ontario, Canada (On-site)
Performance Engineering
Software Engineering
C/C++
Python
2w agoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM