Inference Jobs logo
Inference Jobs
  1. Home
  2. Jobs
  3. United States
  4. New York
  5. New York
  6. AI Infrastructure

AI Infrastructure Jobs in New York, NY, United States

Browse 98 AI Infrastructure jobs in New York, NY, United States on Inference Jobs.

81-98 of 98 jobs
1w agoCohere logoCO

Staff Software Engineer, Inference Infrastructure

Cohere

San Francisco, California, US or Remote (Canada + 3 more)
Inference
Model Serving
Kubernetes
Distributed Systems
6d agoOpenRouter logoOP

Engineering Manager, Platform

OpenRouter

United States (Remote)$245K – $295K Yearly
Engineering Management
Platform Engineering
Cloudflare
GCP
2w agoEliseAI logoEL

AI Operations Specialist | Housing (New Grads 2025-2026)

EliseAI

New York, New York, United States (On-site)$60K – $90K Yearly
AI Operations
Operations Specialist
SQL
Data Analysis
2w agoNebius logoNE

Developer Advocate - Token Factory

Nebius

United States (Remote)$165K – $250K Yearly
Developer Advocate
Developer Relations
AI/ML
Python
1w agoOpenAI logoOP

Software Engineer, Infrastructure Security

OpenAI

US or Remote (United States)$230K – $385K Yearly
Infrastructure Security
Security Engineering
Python
Go
1w agoBaseten logoBA

Senior Software Engineer - Model Training

Baseten

San Francisco, California, US or Remote (Worldwide)$165K – $330K Yearly
Software Engineering
ML Infrastructure
Go
Python
Subscribe to this search

Get email updates when new jobs match this search.