LLM Engineering Jobs in New York, United States

Discover LLM Engineering roles in New York, United States on Inference Jobs and apply today.

1mo agoPE

Backend Software Engineer

Perplexity

Worldwide (Remote)$220K – $405K Yearly
4w agoNE

GPU Cluster Architect

Nebius

United States (Remote)$150K – $180K Yearly
2w agoAN

Partner Solutions Architect, Applied AI

Anthropic

New York, New York, United States (Hybrid)$255K – $345K Yearly
3mo agoD-

Software Engineer, Staff - SIMD Kernels

d-Matrix

Santa Clara, Ca, Ca, United States or Remote (United States)$190K – $300K Yearly
3mo agoCO

Audio Inference Engineer, Model Efficiency

Cohere

New York, United States or Remote (New York, United States + 3 more)
3mo agoMO
4w agoD-

Compiler Architect

d-Matrix

Santa Clara, California, US or Remote (United States + 1 more)$190K – $300K Yearly
3mo agoEL
1mo agoOP
2mo agoPI

Staff Product Manager, Knowledge

Pinecone

New York, New York, United States (On-site)$200K – $275K Yearly
3mo agoCE

AI Models, Product Manager

Cerebras

Sunnyvale, California, United States or Remote (United States)
3mo agoOP

AI & Provider Operations Engineer

OpenRouter

United States or Remote (United States)