AI Evals Engineer — Evaluation Datasets & Ground Truth

Prophetic Software is not able to sponsor employment visas now or in the future. Candidates must be authorized to work in the United States without current or future sponsorship to be considered for this role.

• Experience building or evaluating ML or LLM-powered systems in production, in a role where output quality was your problem.
• You have built evaluation or validation datasets before and can talk about one in detail: how you defined correctness, how you sourced labels, what went wrong, how you knew the labels were good.