Director, Applied AI Assessment Solutions
College Board, Remote - USA
College Board, Remote - USA
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Type: This is a full-time position
As a Director, Applied AI Assessment Solutions, you translate deep item-development expertise into working AI solutions for the programs you support—applying hands-on fluency in item development and review, automated item generation (AIG), retrieval-augmented generation (RAG), prompt and context engineering, agentic workflow design, and systematic output evaluation to accelerate assessment content development across College Board’s programs.
Working as part of an internal consultancy, you help identify and scope the engagements where your expertise will have the greatest impact, partnering with the Executive Director and program stakeholders to assess opportunity, negotiate scope, and define what a successful engagement looks like before work begins. During engagements, you partner with a program’s content team representatives to design and build point solutions that address specific production challenges.
You also contribute to longer-range AI-enablement initiatives to integrate applied AI functionality into content authoring and item banking systems.
Across your engagements, you’ll play a crucial role in shaping how College Board’s programs leverage new tools to support their content teams, ethically and effectively integrating AI technology in assessment creation and review. With your team, you work to maximize ROI and efficiency of each tool, minimizing duplicative efforts across the enterprise, while meeting each program’s unique requirements.
Assessment Design & Development (AD&D) is Learning & Assessment’s content engine—the department responsible for the item and assessment development that powers the SAT Suite. AD&D is expanding its mandate: beyond sustaining operational excellence for SAT, the department is building the shared infrastructure to scale content production across programs and designing the new item types and assessment formats the future of assessments demands.
Applied AI Assessment Solutions is AD&D’s team dedicated to this work: leading the shared strategy, standards, systems design, and prototype tooling that let every College Board program accelerate item development without compromising quality. The team operates as an internal, enterprise-wide consultancy: Directors, Applied AI Assessment Solutions, work across College Board’s assessment programs—including the SAT Suite, AP, ACCUPLACER, CLEP, and PAA—partnering closely with each program’s content teams to design solutions that help programs accelerate and scale item development.
At College Board, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
OpenAILondon, UK
Pay not posted
Posted Sep 2, 2026
OpenAISan Francisco +2
$251K–$278K / yr
Posted 9 days ago
Acadia Pharmaceuticals Inc.Princeton, New Jersey +2
$202K–$252K / yr
Posted Sep 1, 2026
DeloitteTampa, Florida +5
$131K–$269K / yr
Posted Aug 19, 2026
OpenAISan Francisco +1
$280K–$300K / yr
Posted Oct 1, 2026
Blend360Columbia, Maryland
$200K–$290K / yr
Posted Jul 19, 2026
Source: the College Board Workday careers site. We last checked this job 1 h ago. We first saw it 1 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at College Board yet. Did you interview there? Add the questions.
This base pay is below the median for director-level ML and AI engineering jobs in the US.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.