Staff + Senior Software Engineer, Inference

Significant software engineering experience, particularly with distributed systems

Results-oriented, with a bias towards flexibility and impact

Enjoy pair programming (we love to pair!)

Desire to learn more about machine learning systems and infrastructure

Thrive in environments where technical excellence directly drives both business results and research breakthroughs

Experience with high-performance, large-scale distributed systems

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide.

We bring Claude to life by serving our models via the industry's largest compute-agnostic inference deployments.  We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators.

to serve our explosive customer growth, while

enabling breakthrough research

by giving our scientists the high-performance inference infrastructure they need to develop next-generation models.

We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.