Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. LLM Runtimes

LLM Runtimes Jobs

Explore LLM Runtimes roles on Inference Jobs and apply today.

2w agoTA

Senior Machine Learning Engineer, Voice AI

Together AI

San Francisco, California, United States (On-site)$200K – $260K Yearly
Machine Learning Engineer
AI Engineer
Machine Learning
Python
2w agoNE

Senior Software Engineer - Search Runtime

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)
Backend Development
Software Engineering
C++
Rust
3mo agoOP

Software Engineer, Codex Runtime

OpenAI

San Francisco, California, United States (On-site)$255K – $325K Yearly
Software Engineering
Infrastructure Engineering
Distributed Systems
Container Orchestration
3mo agoD-

Senior Runtime Software Engineer

d-Matrix

Sydney, New South Wales, Australia (Hybrid)
Embedded Software
Firmware Engineering
C Programming
RTOS
3mo agoCE

Senior Runtime Engineer

Cerebras

Sunnyvale, California, United States (On-site)
Software Engineer
Distributed Systems
C/C++
Distributed Systems
3w agoTE

Software Engineer, Metal Runtime (API & Abstractions)

Tenstorrent

Santa Clara, California, United States (Hybrid)$100K – $500K Yearly
Software Engineering
Embedded Software
C
C++
3mo agoD-

Senior Runtime Systems Engineer

d-Matrix

Santa Clara, California, United States (Hybrid)
Embedded Systems
Firmware Engineering
C++
C
3mo agoTE

Software Engineer, Metal Runtime

Tenstorrent

Santa Clara, California, United States (Hybrid)$100K – $500K Yearly
Embedded Software Engineer
Software Engineer
C
C++
3mo agoD-

Principal AI/ML System Software Engineer

d-Matrix

Santa Clara, California, United States (Hybrid)$180K – $280K Yearly
AI/ML Engineering
Machine Learning Infrastructure
System Software
C++
3mo agoOP

AI & Provider Operations Engineer

OpenRouter

United States or Remote (United States)
AI Operations
DevOps
TypeScript
JavaScript
2mo agoNV

Senior Software Engineer, AI Inference Systems

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $356.5K Yearly
Senior Software Engineer
AI Inference
Python
C/C++
2mo agoNV

Senior Software Engineer, AI Inference Systems

NVIDIA

Toronto, Ontario, Canada (Hybrid)C$170K – C$275K Yearly
AI Engineering
Software Engineering
Python
C/C++
2mo agoTA

Research Engineer, Core ML

Together AI

San Francisco, California, United States (On-site)$200K – $280K Yearly
Machine Learning Research
Machine Learning Engineer
RL Algorithms
Inference Optimization
2mo agoXA

Member of Technical Staff, Model Evaluation

xAI

Palo Alto, California, United States (On-site)$180K – $440K Yearly
Machine Learning Engineer
Model Evaluation
Python
JAX
3w agoOP

TL, Research Inference

OpenAI

San Francisco, California, United States (On-site)$380K – $555K Yearly
Research Engineering
Machine Learning Infrastructure
High-Performance Inference
Model Execution
3mo agoPO

Member of Engineering (Scalability)

Poolside

United Kingdom or Remote (Europe, Middle East, and Africa, North America)
R&D
Machine Learning Infrastructure
Linux Kernel
PyTorch