Principal Machine Learning Engineer

• Own the metric framework for Paloma's AI systems: translate operational and product goals into technical metrics the squad optimises against, keep it current as the roadmap moves, and report progress against it to the Leadership Team
• Define, with our Consultant Child Psychiatrists, what a complete and accurate AI output looks like for different case types, and what the threshold for evidence sufficiency is at each stage of the assessment pathway
• Set the evaluation standard for the squad: specify what evaluation must exist for each part of the pipeline and what a change must demonstrate before it ships, working in close partnership with the AI Engineers who build and run those pipelines
• Lead structured error analysis across the pipeline, attributing failures to specific stages rather than treating quality as a single aggregate number
• Own machine learning architecture decisions, including model selection, agent and harness design and document the reasoning and evidence behind them
• Establish metric-driven development as the default across the squad and the wider engineering team, through mentoring, technical review, and championing the practice with product and clinical colleagues
• Document technical decisions and specifications in line with healthcare regulatory requirements

• Substantial experience building machine learning systems within companies that reached real users, including at least one where you owned how quality was measured
• A track record of defining metrics in an ambiguous domain — you have been the person who decided what to measure, not only the person who optimised against a target someone else set
• Deep experience of experimental design and error analysis: designing evaluations that isolate cause, attributing failures to specific components, and making architectural decisions on evidence
• Experience working directly with domain experts to convert tacit professional judgement into criteria a system can be evaluated against
• Deep understanding of designing and shipping agents and the harness around them: orchestration, tools and MCP integrations, context and memory management, and verification loops.
• Proficiency in Python, with a strong grasp of clean, typed, tested code and good software engineering practice
• Excellent communication skills, including the ability to make a technical argument to a domain expert or commercial audience and to change your mind in public when the evidence says so

• Experience in an operationally intensive business (logistics, marketplaces, on-demand services or similar) where metric definition was central to how decisions were made
• Familiarity with systematic LLM evaluation techniques such as golden and regression datasets, LLM-as-judge pipelines, structured error analysis, human-in-the-loop review with domain experts
• Experience working with health data and adhering to regulatory requirements
• Experience with synthetic data generation or rubric-based evaluation for expert-judgement tasks
• Experience mentoring AI engineers, or a period leading a small team

Why join Paloma?

For all employees, we offer

• A strong and positive culture that prioritises team building, transparency, and career development. This includes protected time and budget for team connection and learning.
• Comprehensive compensation, including:
• Salary of £150,000 per year, with some flexibility based on experience.
• Annual salary reviews, ensuring they are competitive
• 5% employer pension contribution
• Equity compensation through Share Options in Paloma Health
• Optional Private Medical Insurance and Employee Assistance Programme
• Home Office Equipment Allowance
• A unique annual leave benefits package which includes:
• 37 days of annual leave. This is 28 standard days, plus eight bank holidays, plus your birthday off.
• Option to buy an additional 5 days per year (giving a maximum of 42 days)
• Where required, 2 days per year of special leave, for events that can happen in life, whether personal or family-related
• Additional benefits include:
• A premium performance company laptop
• NHS discounts, including the Blue Light Card (as we are an NHS provider).

• Loved by families, with 4.9 out of 5 Trustpilot and Google ratings
• Care Quality Commission (CQC) registered and quality-focused
• Clinically-led, with a team of over 170 people, including over 100 clinicians supporting families through their care journey. We are hiring 100+ more roles over the next 12 months.
• A community of passionate, mission-driven and innovative team members who challenge the status quo and test and learn from new ideas and approaches.
• In control of our own destiny, as we are profitable and backed by leading healthcare investors Triple Point and Heal Capital

What’s next?

• Whilst we have reduced wait times, it is estimated that up to 500,000 children are still waiting for an NHS autism or ADHD assessment. We won’t rest until this comes down.
• We want to build new services to support families and children diagnosed with autism or ADHD who feel lost after their assessments when the NHS is no longer there for them.

Accommodations

We’re glad to accommodate candidates who need adjustments throughout the hiring process. We encourage you to be open about the adjustments you need, so we can adapt our interview process accordingly.

Keeping our staff and the families we serve safe is a top priority. As part of our pre-employment checks, you may be asked to complete a Disclosure and Barring Service (DBS) check. Depending on your role within the business, this will be at either an Enhanced, Standard, or Basic level.

Application process

Please apply via our website. We understand that applying for a new job requires significant effort, and we appreciate the time you put into it and look forward to reviewing your application.

Our mission is to make NHS autism and ADHD assessments and care accessible within 4 weeks of a GP referral, and, in turn, help every child achieve their potential.

In 2024, our founders, Mark and Darshak, were shocked to find that children needing an NHS autism or ADHD assessment were waiting 4-10 years for these assessments. Delayed assessments can result in children being more likely to develop mental health conditions and fall behind in education. Furthermore, the much-needed pre/post-assessment support (outside of ADHD medications) is typically not funded by the NHS.

These long waits have built up because of increased recognition and understanding of neurodevelopmental conditions, and a lack of investment and innovation within the NHS to meet growing demand.

Mark and Darshak, with their 25 years of combined NHS experience, including building services that have treated over 1,000,000 patients in obesity & ophthalmology, founded Paloma to change this.

As of May 2026, we have successfully reduced waits to less than 3 months by;

• Taking a product-first approach to redesign the care pathway to give families a more consumer-like experience of care
• Our in-house product, engineering and AI team building our own autism and ADHD specific electronic health record and AI clinical support tool to free clinicians from their significant documentation burden to refocus on supporting families
• Investing in expanding the clinician workforce and upskilling them in new ways of working.