From Scientific Observations to Mechanisms: Benchmarking Hypothesis Generation by AI Scientists

What this work does

Introduces MechHypoBench, which tests whether AI scientists can infer mechanisms from complex empirical observations across 14 fields and 17.98 million records. Generated hypotheses are evaluated through predictions under withheld conditions, revealing a substantial mechanism-recovery gap.