Machine Learning Lead (LLM)
Blue Rose Research, Remote
What you will do
- Lead and develop a team of senior data scientists. You'll set direction, run planning and standups, give honest feedback, and help each person grow.
- Own the team roadmap with senior leadership, prioritizing the work that most improves what strategists and campaigns actually get from our products.
- Set the bar for what "good" looks like for our AI systems, and build the evaluation infrastructure to measure it: eval sets, human labeling, and LLM-as-judge pipelines.
- Lead the training and calibration of judge models, making sure they track expert human judgment and stay reliable as products and underlying models change.
- Build systems that use those judges to automatically optimize context (prompts, retrieval, examples, and agent workflows), so quality improves continuously instead of through hand-tuning.
- Guide decisions about when to use off-the-shelf models, when to fine-tune open-weight models, and how to get them into production.
- Keep the team's model work connected to the product by partnering with engineering and political strategists on how real users interact with what we build.
- Balance rigor with pragmatism, making clear tradeoff calls when a real deadline and a real user are on the line.
- Communicate results and tradeoffs clearly to technical and nontechnical audiences, including in client-facing settings.
What you need
- Has 6+ years of experience in ML, data science, or applied statistics, including 1+ years leading a team as a manager or tech lead.
- Has shipped ML or LLM-powered features to production, not just research prototypes or analyses.
- Has a strong grounding in applied statistics.
- Is proficient in Python, SQL, and modern ML frameworks (PyTorch, JAX, or similar), and comfortable with cloud and production tooling.
- Has good product instincts and cares about how the end user will experience the model through the product.
- Is a leader people want to work for: clear, direct, invested in teammates' growth, and able to keep a team focused when priorities shift quickly.
- Is energized by ambiguous problems, like translating "help win elections" into production models.
Join us! We are a remote-first company with an office in NYC and regular team meetups. We primarily work East Coast hours. The salary range for this position is $165,000 - $210,000 annually, commensurate with experience. We offer medical, dental, vision, 401k match, 20 weeks paid parental leave, fertility and family-building support through Maven Clinic, and unlimited PTO. You don't need to meet every qualification to apply. We welcome applicants from all backgrounds. Candidates must be authorized to work lawfully in the United States.
Similar jobs at other companies
ML Research Engineer
White CircleParis +1
Pay not posted
Posted Jul 2, 2026
Research Engineering Lead
LovableStockholm
Pay not posted
Posted Jun 22, 2026
Machine Learning Engineer, LLM Post-Training
NewsBreakMountain View, California +1
$150K–$230K / yr
Posted Jun 10, 2026
Machine Learning Engineer
Lovelace AILovelace HQ
Pay not posted
Posted 8 days ago
Source: the Blue Rose Research Greenhouse job board. We last checked this job 33 min ago. We first saw it 7 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.