Engineering Manager, Agent Oversight

Proven success in leading, managing, and developing high-performing Engineering teams

Expertise in identifying product engagement patterns and trends for large scale consumer products

Track record of shipping high-quality products and features at scale

Ability to turn business and product ideas into engineering solutions

.

Manage the engineering team and drive technical delivery

Work across the entire product lifecycle from conceptualization through production

Build features end-to-end: back-end, system design, debugging and testing

Deliver experiments at a high velocity and level of quality to engage our customers

Influence the culture, values, and processes of a growing engineering team

Inspire and mentor engineers

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

The vision for the AgentOps team is to build the best Agent Development Platform in the AI Industry.

Agent Development is in its nascent stages in a rapidly changing industry, with limited tooling making it hard for agent developers to manage agent lifecycles. As a team that has a front-row seat to what Enterprise customers need and want, we want to build an opinionated but flexible platform for all Agent operations ("AgentOps"), including building, deploying, monitoring, evaluating and improving agents to solve customer needs.

With the AI industry currently moving towards RL workflows that need verifiable rewards, we further want to gear this platform towards knowledge capture that create compounding effects to make Agents more effective and capable. We want to create a virtuous data flywheel where agents built using this platform see continuous performance improvements and increase customer value over time.

We are a rapidly growing team with ambitious goals, and are looking for motivated individuals to join us to make an impact in a green-field domain.