Staff Machine Learning Engineer, Generative AI (Auth0)

Strong programming expertise in Python (and familiarity with Go or Typescript a plus).

Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).

Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.

Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).

Experience with LiteLLM, LangGraph, LangChain, DSPy, LlamaIndex, MCP, or other related AI agent frameworks.

Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.

:

As a Staff Machine Learning Engineer on the Generative AI team, you will help shape and accelerate our Generative AI strategy by contributing across the stack of model development, infrastructure, and platform services. You’ll drive design and implementation of production-ready AI/ML systems at scale—ranging from LLM-powered features to reusable platform components that other teams across Okta can build on.

Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.

Drive technical decision making while striving to hit the right balance between factors such as simplicity, flexibility, reliability, and performance.

Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and establishing scalable LLMOps pipelines in production.

:

Have you ever considered what powers the intelligent features behind seamless product experiences? The AI Frameworks and Services team is at the forefront of enabling AI-driven innovation across our organization. We build the foundational frameworks and essential services that empower engineering teams to integrate cutting-edge AI capabilities into our products, transforming how our users interact with them. From crafting intuitive generative AI-powered chat experiences that provide instant product support, to developing the best developer experience around authentication for generative AI and AI agents, as well as implementing intelligent security features, our team is instrumental in bringing the transformative power of AI to life. We collaborate closely with the Machine Learning team and various product teams to ensure the seamless and secure delivery of AI-enhanced features that provide real value to our users.