Inference Jobs logo

Inference Jobs

  1. Home
  2. Jobs
  3. United States
  4. LLM Frameworks

LLM Frameworks Jobs in United States

Discover LLM Frameworks roles in United States on Inference Jobs and apply today.

4w agoTA

LLM Inference Frameworks and Optimization Engineer

Together AI

San Francisco, California, United States (On-site)$160K – $230K Yearly
Machine Learning Engineer
AI Research Engineer
LLM Inference
TensorRT-LLM
2mo agoNV

Senior Deep Learning Algorithm Engineer, Training Framework

NVIDIA

Santa Clara, California, United States (Hybrid)$184K – $287.5K Yearly
Deep Learning
AI Infrastructure
Megatron Core
NeMo Framework
3mo agoHA

LLM Inference Engineer

Hippocratic AI

Palo Alto, California, United States (On-site)
LLM Engineering
Machine Learning Engineering
LLM Inference
Distributed Serving
3mo agoPL

LLM Inference Engineer

Periodic Labs

Menlo Park, California, United States (On-site)
LLM Engineering
Machine Learning Infrastructure
LLM Inference
TensorRT-LLM
3d agoNV

Senior Deep Learning Software Engineer, LLM Performance

NVIDIA

Santa Clara, California, United States (On-site)$184K – $356.5K Yearly
Deep Learning Engineering
LLM Performance Engineering
Python
C++
2mo agoNV

High-Performance LLM Training Engineer - New College Grad 2026

NVIDIA

Santa Clara, California, United States (On-site)$124K – $195.5K Yearly
Machine Learning Engineer
Deep Learning Engineer
HPC
LLM Training
2mo agoNV

Senior Software Engineer – TensorRT Edge-LLM

NVIDIA

Santa Clara, California, United States (Hybrid)$152K – $287.5K Yearly
Software Engineering
AI Engineering
C++
CUDA
7d agoSC

Tech Lead Manager- MLRE, ML Systems

Scale

San Francisco, California, United States (On-site)$264.8K – $331K Yearly
Machine Learning
MLOps
LLM
Distributed Systems
4w agoSC

ML Research Engineer, ML Systems

Scale

San Francisco, California, United States (On-site)$218.4K – $273K Yearly
Machine Learning Engineer
ML Research
CUDA
PyTorch
3mo agoD-

Machine Learning Intern - Dynamic KV-Cache Modeling for Efficient LLM Inference

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (California, United States)$30 – $59 Hourly
Machine Learning Intern
AI Research
Machine Learning
Large Language Models (LLM)
3mo agoSE

ML Model Serving Engineer

Sesame

San Francisco, California, United States (On-site)$175K – $280K Yearly
Machine Learning Engineer
AI Engineer
LLM Serving
VLLM
2mo agoCE

Senior Full Stack LLM Engineer - Training

Cerebras

Sunnyvale, California, United States (On-site)
Machine Learning Engineer
LLM Engineering
Python
PyTorch
2w agoAN

Machine Learning Systems Engineer, RL Engineering

Anthropic

San Francisco, California, United States (Hybrid)$500K – $850K Yearly
Machine Learning Engineer
ML Infrastructure
Machine Learning
Python
3mo agoOP

Training: ML Framework Engineer

OpenAI

San Francisco, California, United States (Hybrid)$245K – $385K Yearly
Machine Learning Engineer
ML Infrastructure
Python
Machine Learning