The role owns the science of evaluation across every agent, the predictive and decision models behind the shared agents (churn, demand, payment recovery, fraud), and the experiment design that lets Finance count AI value once, against a holdout.
The role is hands-on. At least 50% of time goes to building models, evals and experiments; the rest to setting methods, reviewing, and growing a small team. This role makes what engineers ship measurable, cheaper and trustworthy, and supplies the models where an LLM alone is the wrong tool.
o Set the enterprise eval methodology: golden-set design, sampling, labelling and inter-rater agreement, LLM-as-judge validation, slice analysis and statistical thresholds.
o Own the quality signals in the minimum telemetry contract: task success, groundedness, hallucination and escalation rates.
o Re-run evals per BU and tenant on every agent-core upgrade; catch regressions before customers do.
o Build and run the models the horizontal pods need: churn and retention uplift, payment-recovery propensity and timing, demand and capacity forecasting, later fraud and onboarding risk.
o Choose the right tool per task: classical ML, a small or fine-tuned model, retrieval, or a frontier LLM.
o Ship models to production on the golden path, with monitoring for drift and feedback loops.
o Build the evidence behind model routing: accuracy, cost and latency per task, so routing is a measured decision.
o Drive cost per successful task down through distillation, caching strategy, smaller models and prompt and context optimization.
o Prototype varied techniques (agent memory, planning, multi-agent patterns, synthetic data) against real Xplor problems.
o Turn what works into reference implementations in the golden path; retire what doesn't.
o Bring a monthly view of what has changed in models and methods, and what it means for our roadmap.
o Shape the statistical design of benchmarks and indices: cohort minimums, anonymization, and comparability across businesses.
o Lead entity-resolution modeling with the data team.
o Teach evals, experimentation and probabilistic thinking through the AI-P/SDLC training and office hours.
o Pair with BU engineers on hard model problems in lighthouse BUs; review eval designs for R2 and R3 agents.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Before you apply
To be considered for employment, you must be legally authorized to work in the country where the role is advertised. This applies to remote roles too. Xplor does not sponsor visas, either at the time of hire or at any later time. We're also not able to offer contractor arrangements or Employer of Record engagements for this position at this stage.
Please apply through our careers portal or external job boards only. We're unable to upload emailed applications, as our process requires you to answer screening questions directly.
We also invite you to check out our Candidate FAQs for more information about our recruitment process xplor.com/recruitment-faqs/.
As part of our hiring process, successful candidates will be asked to complete background and identity verification checks. Many of our roles are remote, and to protect both candidates and our business from recruitment fraud, we may record video interviews during the process. We keep any recordings and related data only for as long as the hiring process is active and do not retain them afterwards.
Company Description
At Xplor, we believe that helping people make the most of each day is the most rewarding way to spend ours.
We give small and medium-sized businesses cloud-based, intuitive technology solutions that enable them to manage all the hassles of running and growing a business, so business owners can get back to doing what they love. With Xplor Pay, we help businesses get paid quickly and securely – without hidden fees. We built the tech ourselves, and our platform delivers secure, transparent, fast, and accurate payments.
We are unified by our purpose of helping people to succeed. So, when you become part of our team, you also become part of the personal connection that strengthens the relationship people have with Xplor products.
Job Description
Position overview
The Head of AI/ML R&D decides, with evidence, whether an AI system works, how well, for whom, and at what cost. They come from data science and machine learning, and they build today with AI-native tools and agentic development.
We believe in transparent hiring. We use an applicant tracking system with artificial intelligence-enabled features to support our recruitment process, but our recruitment team makes all hiring decisions after human review. We do not rely on artificial intelligence to make final hiring decisions. Find our Candidate AI Usage guidelines here.
Xplor is proud to be an Equal Employment Opportunity employer. We're dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability, veteran status and age. We encourage applications from all sectors of the community. All Information will be kept confidential according to EEO guidelines.
Xplor is committed to fully including all qualified individuals. In keeping with our commitment, Xplor will take steps to ensure people with disabilities receive reasonable accommodations. Accordingly, if reasonable accommodation is required to fully participate in the job application or interview process, to perform the essential functions of the position, and/or to receive all other benefits and privileges of employment, please contact us via [email protected].
We make it a priority to respond to every applicant.
Pay not posted
Posted Jul 27, 2026
Pay not posted
Posted Jun 15, 2026
Woven by ToyotaPalo Alto, CA +1
$189K–$311K / yr
Posted 19 days ago
Pay not posted
Posted Dec 10, 2024
Source: the company job board. We last checked this job 1 h ago. We first saw it 1 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
Pay not posted
Posted Oct 9, 2026
Pay not posted
Posted Oct 6, 2026
No one has reported an interview at Xplor yet. Did you interview there? Add the questions.
This base pay is above the median for director-level ML and AI engineering jobs in the US.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.