Machine Learning Engineer, Core Evaluations
Cantina, Europe +1
The role
We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models.
This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results.
As the founding member of our evaluation team, the ideal candidate is expected to leverage their experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.
What you will do
- Designing model evaluation pipelines for models in development and production
- Designing user studies for subjective model evaluations.
- Converting requirements into measurable metrics.
- Designing and developing automated evaluation dashboard to see model performances and compare results.