webmd
Sr. Manager, Test Automation & AI Evaluation
At a Glance
- Location
- Newark, New Jersey, United States
Requirements
7+ years of experience in quality engineering or test automation, including team leadership or management.\u00A0
Deep, current, hands-on expertise in modern test automation frameworks such as Playwright, Cypress, or Selenium.
Demonstrated experience building automated test suites and integrating them into CI/CD pipelines.
Experience designing evaluation or testing approaches for AI/ML or LLM-powered systems, or a strong data-and-metrics orientation with the ability to build one.
Strong understanding of test strategy, defect management, and release-readiness governance across multiple teams.
Experience testing generative AI or agentic products, including evaluation harnesses, prompt testing, and regression testing for AI flows.
Compensation & Benefits
Bonus Eligible:
This position is also eligible for a discretionary company bonus, based upon business results.
Health Insurance (medical, dental, and vision coverage)
Paid Time Off (including vacation, sick leave, and flexible holiday days)
401(k) Retirement Plan with employer matching
Responsibilities
Manager, Test Automation & AI Evaluation is an automation-first quality leader responsible for quality engineering across the Ignite Growth Platform.
As engineering velocity has accelerated with AI-assisted development, quality assurance has become the rate-limiting constraint; this role exists to remove that constraint.
Manager makes automation the default, builds the evaluation discipline required to test AI-powered and agentic features, and applies AI to the practice of QA itself.
This role also provides direct leadership of the existing Educate quality assurance team and serves as the head of quality assurance across Ignite, owning quality standards, test strategy, and release-readiness governance organization-wide.
Lead an automation-first quality strategy, eliminating manual testing waste and making automated testing the default across teams.
Own modern test automation frameworks and end-to-end automated coverage, with deep, current expertise in Playwright and comparable frameworks.