sonyinteractiveentertainmentglobal
Software Development Engineer in Test, ML/AI
At a Glance
- Location
- United States, San Mateo, Canada
- Experience
- 3+ years
- Posted
- 2026-06-16T19:31:36-04:00
Key Requirements
Required Skills
Domain Knowledge
- Automation
Benefits & Perks
for SIE’s top-tier benefits package that includes medical, dental, vision,
Requirements
3+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.
Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.
Strong experience testing RESTful APIs, microservices, and distributed architectures.
Proficiency in Python, Java, JS or similar languages for automation development.
Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.
Responsibilities
Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.
Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.
Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
Lead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.
Design, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.
Build automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.