LLM Infrastructure Engineer Jobs
Explore LLM Infrastructure Engineer roles on Inference Jobs and apply today.
1mo ago
SC
AI Infrastructure Engineer, Model Serving Platform
Scale
San Francisco, California, United States (On-site)$179.4K – $224.3K Yearly
2mo ago
DE
Staff Software Engineer, ML Infrastructure
Decagon
San Francisco, California, United States (On-site)$300K – $430K Yearly
3mo ago
OP
Software Engineer, Data Infrastructure - Research
OpenAI
San Francisco, California, United States (On-site)$250K – $380K Yearly
2w ago
NV
Senior Infrastructure and Methodology Engineer for SoC-Clocks
NVIDIA
Shanghai, Shanghai, China (On-site)
1mo ago
TA
LLM Inference Frameworks and Optimization Engineer
Together AI
San Francisco, California, United States (On-site)$160K – $230K Yearly
2mo agoTA
Engineering Manager, Model Serving
Together AI
San Francisco, California, United States (On-site)$250K – $300K Yearly
2mo agoNV
High-Performance LLM Training Engineer - New College Grad 2026
NVIDIA
Santa Clara, California, United States (On-site)$124K – $195.5K Yearly
6d agoNV
Senior Performance Engineer - LLM Inference Frameworks
NVIDIA
Yokne'am, Northern District, Israel (Hybrid)
3w ago
AN
Machine Learning Systems Engineer, RL Engineering
Anthropic
San Francisco, California, United States (Hybrid)$500K – $850K Yearly
2mo agoNV
Senior AI Software Development Engineer, TensorRT-LLM
NVIDIA
Yokne'am, Northern District, Israel (Hybrid)