Vals AI, San Francisco
We are looking for an exceptional researcher to design and build the next generation of AI benchmarks for cybersecurity. You will create high-impact, challenging evaluations that push the boundaries of what we can measure in foundation models. This role is ideal for someone with deep research expertise who wants to see their work directly influence how the world evaluates AI systems.
You will lead the design and development of novel benchmarks that assess real-world capabilities and risks of LLMs. Our benchmarks shape how foundation models are developed and generative AI applications are built. We work with every major foundation model lab - along with leading financial institutions and the application-layer companies pushing the frontier forward. Our work has been featured by the Wall Street Journal, New York Times, Washington Post, and Bloomberg.
We are building the standard for evaluating the ability of LLMs to perform real-world tasks. You will be at the forefront of defining what that standard looks like.
Note: This is an application for those specifically interested in building benchmarks to assess cyber capabilities. If you are interested in other domains, please see our general research posting https://jobs.ashbyhq.com/vals-ai/7f54d989-4999-4857-b480-e6d113a263aa. We encourage you to only apply to one research posting.
Founding team: The core methodology behind this platform comes from NLP evaluation research we conducted at Stanford. We raised a $5M seed from some of the top institutional and angel investors in the valley. Our team has prior work experience at NVIDIA, Meta, Microsoft, Palantir and HRT. Collectively, we have over 300 citations in our published work. Our early team includes Stanford PhDs, ex-Jane Street quants, and the first designer at Snorkel.
We recently announced our $40M Series A at a $400M valuation, led by Andreessen Horowitz https://www.linkedin.com/company/a16z/, with participation from existing investors 8VC https://www.linkedin.com/company/8vc/, Pear VC https://www.linkedin.com/company/pear-vc/, and Bloomberg https://www.linkedin.com/company/bloomberg/ and new investors Hudson River Trading https://www.linkedin.com/company/hudson-river-trading/ and NextLadder Ventures https://www.linkedin.com/company/nextladderventures/.
Tech stack: We use Python for most things at Vals AI. Our platform is built on Django, with a React frontend. All of the infra is on AWS using CDK for IaC.
CA$250K–CA$535K / yr
Posted Oct 22, 2025
$180K–$230K / yr
Posted 4 days ago
CollinearSunnyvale, California +2
Pay not posted
Posted Sep 22, 2026
Pay not posted
Posted Jun 28, 2026
AnthropicRemote-Friendly +2
$300K–$405K / yr
Posted Sep 1, 2026
$250K–$400K / yr
Posted 23 days ago
Source: the Vals AI Ashby job board. We last checked this job 1 h ago. We first saw it 9 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at Vals AI yet. Did you interview there? Add the questions.
This base pay is below the median for AI research jobs in the Bay Area with no level in the job title.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.