Forward Deployed Engineer, AI Trust and Reliability
Hopper, Canada - Remote +3
Hopper has this job in 1 other place
The role
Hopper powers travel for some of the world's largest banks, airlines and travel companies, and our AI agents act on their customers' behalf by looking up accounts, changing and cancelling bookings, and handling payments and loyalty points. As the Forward Deployed Engineer, AI Trust and Reliability, you make sure that AI is safe, secure and ready for production in every partner deployment. You work in a small forward-deployed team as the person who owns guardrails, adversarial testing, launch readiness and partner security reviews, and you are the bridge between our partners' security, risk and IT teams and Hopper's engineering and security teams.
What would your day-to-day look like
- Tailor guardrails to each partner's policies, regulations, risk appetite and languages, covering what the AI may do, what it must refuse and when it hands off to a human
- Design protections for sensitive data and actions, including data masking, identity checks and customer consent before any change to a booking or payment
- Tune guardrails so they stop real risks without blocking legitimate customers
- Red-team every deployment before launch and after significant changes, testing for jailbreaks, prompt injection, data leakage, unauthorized actions and social engineering
- Build and maintain automated adversarial test suites that run continuously, in every language a partner serves
- Turn findings into fixes with engineering, and into regression tests so they stay fixed
- Lead partner security questionnaires, architecture reviews and AI or model-risk reviews, and respond to partner penetration-test findings
- Document how our AI handles data, access and decisions in terms a regulator or auditor would accept
- Own the go-live checklist for each deployment, covering functional, regression, safety and load testing, sign-off criteria and rollback plans
- Extend our automated testing across products, so every model, prompt or configuration change is tested before it reaches customers
- Coordinate user acceptance testing with partners and close out issues before launch
- Lead the security and privacy side of partner data access for our forward-deployed teams, including data-sharing agreements, IT security reviews and secure access to partner systems, including on-premise ones
- Define how partner data is handled, stored, separated and deleted across deployments and model training, and make sure it is followed
- Monitor live deployments for quality, reliability, abuse and safety failures, and set up dashboards and alerting with engineering
- Lead the response when a safety or security issue occurs, with clear communication to the partner throughout