Senior SDET

• Design and maintain Python-based test automation frameworks for UI (Playwright) and REST APIs — reusable, scalable, and maintainable across the team's test suites
• Build automated evaluation suites for AI/LLM-powered features — tracking output correctness, hallucination rate, and regression across model/prompt versions — using tools such as Langfuse, Ragas, or equivalent
• Collaborate with engineering leads to define and integrate CI/CD quality checks in GitHub Actions — wiring test suites and evaluation runs into the pipeline and agreeing on pre-merge gates that block on failed tests, evaluation-score thresholds, or schema-compatibility issues
• Set testing standards and best practices for automation and AI evaluation, and mentor other SDETs on the team
• Contribute to acceptance criteria and flag quality risks early, working with cross-timezone engineering and product stakeholders
• Execute release verification for assigned features — feature-flag checks, smoke tests, and rollback validation

• 5+ years as an SDET with end-to-end quality ownership across web apps, backend APIs, and release processes
• Strong Python skills for test automation, API testing, and Pytest; hands-on experience with Playwright
• Experience evaluating AI/LLM-powered features — familiarity with metrics such as hallucination rate, output correctness, or LLM-as-judge approaches, and hands-on experience with at least one evaluation/tracing tool (e.g., Langfuse, Ragas)
• Experience integrating quality checks into CI/CD pipelines in GitHub Actions (or equivalent) — writing and maintaining pre-merge checks, test/quality gates, and pipeline configuration
• Track record of setting testing standards or mentoring other engineers/SDETs
• Strong communication skills; comfortable working across time zones
• Bachelor's in CS, Engineering, or equivalent experience

• SQL proficiency and experience validating ETL/batch transforms in Snowflake, Athena, or equivalent; familiarity with idempotency and failure recovery
• Experience testing access control and data security in multi-tenant systems (RBAC, dataset-level permissions); exposure to compliance frameworks such as HIPAA, SOC 2, or HITRUST
• Working knowledge of AWS (S3, ECS, CloudWatch) and tracing/logging tools
• Experience conducting performance, load, or stress testing (k6, JMeter)
• Familiarity with healthcare data infrastructure, the OMOP Common Data Model (CDM), or clinical vocabularies

Why Verantos?

Work at the intersection of cutting-edge tech, complex data, and healthcare research — where your quality engineering directly shapes research-grade evidence.

We Offer

Competitive salary

Comprehensive medical benefits and work-life balance

Collaboration with healthcare technology visionaries