Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. Low Latency Optimization

Low Latency Optimization Jobs in United States

Discover Low Latency Optimization roles in United States on Inference Jobs and apply today.

4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
2mo agoNV

Senior GPU Low Power Architect

NVIDIA

Santa Clara, California, United States (On-site)$136K – $264.5K Yearly
Hardware Engineering
GPU Architecture
GPU Architecture
Low Power Architectures
3mo agoDE

Senior Software Engineer, Voice Agent

Decagon

San Francisco, California, United States (On-site)$250K – $330K Yearly
Software Engineering
Voice Engineering
Typescript
Python
4w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoDE

Staff Software Engineer, Voice Agent

Decagon

San Francisco, California, United States (On-site)$300K – $375K Yearly
Software Engineering
Staff Engineer
Real-time Systems
Streaming Pipelines
4w agoOP

Senior Software Engineer, Infrastructure

OpenAI

Bellevue, Washington, United States (Hybrid)$293K – $325K Yearly
Infrastructure Engineering
Software Engineer
Distributed Systems
Data Ingestion
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
2mo agoNV

Senior Software Engineer – TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$152K – $287.5K Yearly
Software Engineering
AI Engineering
C++
CUDA
1mo agoLA

Principal Product Manager – Networking

Lambda

San Francisco, California, United States (Hybrid)$323K – $484K Yearly
Product Management
Technical Product Management
Product Management
Cloud Infrastructure
2w agoAN

TPU Kernel Engineer

Anthropic

San Francisco, California, United States (Hybrid)$280K – $850K Yearly
Kernel Engineering
Machine Learning Engineering
TPU
ML Systems
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
2mo agoTA

Research Engineer, Core ML

Together AI

San Francisco, California, United States (On-site)$200K – $280K Yearly
Machine Learning Research
Machine Learning Engineer
RL Algorithms
Inference Optimization
2mo agoCE

Senior Full Stack LLM Engineer - Training

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
LLM Engineering
Python
PyTorch
3mo agoCO

Member of Technical Staff, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
Modeling
Machine Learning Engineer
C++
Python
1mo agoAI

ML Runtime Optimization Engineer

Applied Intuition

Sunnyvale, California, United States (On-site)$159.1K – $199.3K Yearly
Machine Learning Engineering
Embedded Software Engineering
PyTorch
JAX