webmd

Sr. Manager, Test Automation & AI Evaluation

Apply Now

At a Glance

Location
Newark, New Jersey, United States

Requirements

7+ years of experience in quality engineering or test automation, including team leadership or management.\u00A0

Deep, current, hands-on expertise in modern test automation frameworks such as Playwright, Cypress, or Selenium.

Demonstrated experience building automated test suites and integrating them into CI/CD pipelines.

Experience designing evaluation or testing approaches for AI/ML or LLM-powered systems, or a strong data-and-metrics orientation with the ability to build one.

Strong understanding of test strategy, defect management, and release-readiness governance across multiple teams.

Experience testing generative AI or agentic products, including evaluation harnesses, prompt testing, and regression testing for AI flows.

Compensation & Benefits

Bonus Eligible:

This position is also eligible for a discretionary company bonus, based upon business results.

Health Insurance (medical, dental, and vision coverage)

Paid Time Off (including vacation, sick leave, and flexible holiday days)

401(k) Retirement Plan with employer matching

Responsibilities

Manager, Test Automation & AI Evaluation is an automation-first quality leader responsible for quality engineering across the Ignite Growth Platform.

As engineering velocity has accelerated with AI-assisted development, quality assurance has become the rate-limiting constraint; this role exists to remove that constraint.

Manager makes automation the default, builds the evaluation discipline required to test AI-powered and agentic features, and applies AI to the practice of QA itself.

This role also provides direct leadership of the existing Educate quality assurance team and serves as the head of quality assurance across Ignite, owning quality standards, test strategy, and release-readiness governance organization-wide.

Lead an automation-first quality strategy, eliminating manual testing waste and making automated testing the default across teams.

Own modern test automation frameworks and end-to-end automated coverage, with deep, current expertise in Playwright and comparable frameworks.