A real research problem
A task from your experiments, analysis, code, recordings, protocols, specialist software, or a whole research project.
Contribute to Science’s Last Exam
A task from your experiments, analysis, code, recordings, protocols, specialist software, or a whole research project.
Requires scientific knowledge and reasoning.
Include a reference result, executable checks, or a scoring rubric.
The question, starting state, and constraints.
Data, code, recordings, or documents the agent can use.
Tools, versions, licenses, and runtime requirements.
The files, results, or decisions the agent must deliver.
Reference results, tests, and tolerances—kept separate from agent inputs.
Files: Upload up to 50 MB per file. For larger files, add a Google Drive / Dropbox link and give the review team access.
Review: Complete the five items, then follow review feedback in My submissions.
An AItonomy initiative. Researchers write and review tasks in a personal capacity.
Research contactsly1988@princeton.eduwuyc@stanford.edu