SciΠvot: Benchmarking Principal-Investigator Judgment at Pivotal Moments of Scientific AutoResearch Agents

What this work does

SciΠvot evaluates whether research agents make sound decisions at pivotal moments, using 248 cases derived from human interventions across 26 projects. Frontier models often preferred the original agent plan over the human correction, exposing a major scientific-judgment gap.