Senior Software Engineer, Backend (AI Agent Runtime)

5+ years writing production software; 2+ years focused on ML platform or infra.

Expert Python (async, typing, packaging, performance).

Working Golang knowledge for systems components.

Proven experience with one or more serving frameworks (e.g., vLLM, Triton, TorchServe).

Kubernetes and cloud-native ops.

Solid grasp of distributed systems, networking, and container security.

We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs

Paid parental leave to support you and your family

Monthly Health & Wellness allowance

Work from home office stipend to help you succeed in a remote environment

Lunch reimbursement for in-office employees

PTO: 3 weeks in Canada

Design, build, and maintain low-latency, highly-available serving stacks for in-house ML model serving and integrating with LLM serving partners.

Automate training pipelines:

Orchestrate data prep, training, evaluation, and registry workflows on Kubernetes with solid MLOps practices.

Profile and tune throughput, memory, and cost; introduce caching, sharding, batching, and GPU/CPU autoscaling where it pays off.

Build platform primitives:

Create reusable SDKs, templates, and CLI tools that let research and product teams ship models independently and safely.