If embedded evaluations happen, you will be on one of the following teams:
On-site embedded evaluators: This team will spend weeks or months embedded at a frontier AI lab, where they will conduct interviews, review the lab’s evidence, gather new evidence, and write a report. They will execute a playbook quickly and adapt to unforeseen circumstances. We hold our embedded evaluators to the highest standards, so you will likely have to first prove yourself within Apollo before being sent into an embedded campaign.
That is, you will probably start on the applied research team to gain context on embedded evaluations. For this team, we prefer candidates with the right to work in the US who can be based in San Francisco.
Applied researchers: This team will be the force-multiplier behind embedded evaluations. They will prepare on-site evaluators before they are embedded and support them while they are embedded. They will do the conceptual work to determine what evidence would support a safety case, and write the playbook for on-site evaluators to optimize how fast they can gather evidence. They will develop tooling for embedded evaluators, both ahead-of-time and urgently on demand.
They will be the bridge connecting fundamental research and the on-site evaluators. For example, they might convert the methodology of “Measuring Reward-Seeking via Contrastive Belief Updates” into turnkey code and procedures. This team can work from any of our offices.
Both are high-stakes teams. On-site embedded evaluators should be exceptionally strong at quick execution under high pressure, and very strong at planning and research. Applied researchers should be exceptionally strong at planning and research, and very strong at quick execution under high pressure. For both teams, we are excited for experienced candidates who have owned ambitious projects end-to-end under tight deadlines.