LLM Infrastructure Engineering Jobs

2w ago

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly

Deep Learning Research Engineering

AI Research Engineer

LLM Inference

TensorRT-LLM

3w ago

Senior Deep Learning Research Engineer, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

LLM Inference Optimization

Machine Learning Engineering

6d ago

Software Engineer, Data Infrastructure - Research

OpenAI

San Francisco, California, United States (On-site)$250K – $380K Yearly

2w ago

Engineering Manager, Model Serving

Together AI

San Francisco, California, United States (On-site)$250K – $300K Yearly

Engineering Manager

Kubernetes

Multi-cluster Orchestration

2w ago

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA

Yokne'am, Northern District, Israel (Hybrid)

Performance Engineering

LLM Inference

2w ago

Senior Infrastructure and Methodology Engineer for SoC-Clocks

NVIDIA

Shanghai, Shanghai, China (On-site)

AI Engineering

Full Stack Development

JavaScript

6d ago

Solution Architect (AI/LLM Inference)

Baseten

Worldwide (Remote)$165K – $330K Yearly

Solution Architecture

AI/ML Sales Engineering

AI/ML

2w ago

High-Performance LLM Training Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $195.5K Yearly

Forward Deployed Engineer

Deep Learning Engineer

HPC

LLM Training

4d ago

Forward Deployed Engineer - LLM Post-training

Reflection AI

San Francisco, California, United States (On-site)

ML Engineer

Forward Deployed Engineering

Fine-tuning

2w ago

Senior Tech Recruiter (ML,LLM)

Nebius

Amsterdam, North Holland, Netherlands (Hybrid)

6d ago

Engineering Manager - Forward Deployed Engineering (LLM)

Baseten

San Francisco, California, US or Remote (Worldwide)$260K – $380K Yearly

Engineering Management

Reinforcement Learning Engineering

LLMs

7d ago

LLM Reinforcement Learning Framework Engineer

NVIDIA

Shanghai, Shanghai, China (On-site)

LLM Engineering

2w ago

Machine Learning Systems Engineer, RL Engineering

Anthropic

San Francisco, California, United States (Hybrid)$500K – $850K Yearly

ML Infrastructure

Machine Learning

ML Infrastructure Engineering

3w ago

Senior Deep Learning Researcher, LLM Inference

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-site)

Deep Learning Research

LLM Inference Research

Deep Learning

Large Language Models

13h ago

Member of Engineering (Reinforcement Learning Infrastructure)

Poolside

Northern Europe + 3 more (Remote)

Applied Research

2w ago

Forward Deployed Engineer - ML

Modal

Stockholm, Sweden (On-site)