Senior AI QA Engineer

• 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation.
• Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems.
• AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, and custom scoring algorithms). Familiarity with tools like LangSmith, Arize Phoenix, or MLflow.
• Vibe Coding Mastery: Proficiency with AI-native development tools such as Cursor, Windsurf, Claude Code.
• Modern Automation Stack: Proficiency with frameworks like PyTest, and experience with traditional tools (Cypress, Playwright, or Selenium) for end-to-end flows.
• API & Data Testing: Solid understanding of API testing (Postman/RestAssured) and database validation (SQL/NoSQL).
• Strategic Thinking: Experience serving as a Subject Matter Expert (SME) on test process development for large-scale systems.

• Clinical Domain Knowledge: Familiarity with healthcare data standards such as FHIR, HL7, or SNOMED CT.
• Healthcare Compliance: Understanding of HIPAA regulations and the nuances of handling ePHI/PHI.
• Statistical Foundation: Understanding of sensitivity, specificity, and F1-scores in a clinical context.

As a Senior AI QA Engineer, you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies.

GW RhythmX is revolutionizing healthcare through connected, AI-native intelligence that unites clinical insight, patient engagement, and system-wide care orchestration. The company combines market-leading AI precision care technology with extensive trusted patient engagement leadership to help health systems deliver the right care, at the right time, through the right clinician and channel. Its solutions are deployed across more than 150 health systems, touching more than 85M patients including 8M U.S. military veterans.

The company's award-winning solutions were recognized again in 2024 by KLAS Research, Fierce Healthcare, and AVIA Marketplace. A SymphonyAI Group company, GW RhythmX leverages various firm assets, including $1B+ in R&D investment, longitudinal data related to 300 million patients, 4.4 billion total annual claims, and 1.8 million healthcare professionals at more than 3,000 facilities globally.