About Us
Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.
We are a small, growing, and highly motivated team dedicated to an ambitious technical plan. We operate with a flat mobile organizational structure where all contribute directly to the company’s mission. Leadership is earned by those who show initiative and deliver excellence.
We seek engineers/researchers with strong intrinsic drive, a true passion for advancing the state of the art, and a mix of excellent research, coding, and communication skills.
LOCATION: On-site at our office in San Francisco or Westwood, Los Angeles.
About the Role
We’re looking for a systems engineer with HPC or parallel programming experience to help scale AI inference. You’ll leverage your knowledge of high-performance systems to optimize GPU performance at the bleeding edge of AI.
- Full-Time
- On-site at either our SF or LA offices
Tech Stack
CUDA/C++, GPGPU, Python, Linux
Key Responsibilities
- Design and optimize GPU kernels and tensor libraries
- Translate HPC techniques into scalable AI inference solutions
- Evaluate emerging architectures and resource management approaches
- Collaborate with technical leadership to improve GPU infrastructure efficiency
Ideal Experience
- Advanced C++ (C++17/20 preferred)
- Expertise with at least one parallel framework (CUDA, HIP, SYCL, OpenCL, OpenACC, or similar)
- Strong background in systems optimization and HPC performance tooling
- Familiarity with distributed training/inference frameworks (bonus)
Interview Process
After submitting your application, our technical team reviews your credentials. If selected, you'll proceed through the following stages:
- Initial screening (virtual, 15 minutes)
- Quick dive into Vast, systems and architectures (virtual, 30 minutes)
- LLM-assisted coding assessment (virtual, 1 hour)
- Meet and greet with coding assessment (on-site, 2 hours)
Our goal is to complete the interview process in two weeks.
Annual Salary Range
$160,000 – $320,000 + equity + benefits
Vast.ai is hiring across all experience levels with compensation commensurate with background, experience and potential.
Benefits
- Comprehensive health, dental, vision, and life insurance
- 401(k) with company match
- Meaningful early-stage equity
- Onsite meals, snacks, and close collaboration with founders/tech leaders
- Ambitious, fast-paced startup culture where initiative is rewarded