Null Controls Are Necessary but Not Sufficient: Evaluating Acceptance Guards for Scientific Discovery and Interpretability

What this work does

This work tests acceptance criteria used by automated discovery systems and shows that seemingly successful descriptive tests can admit scientifically empty explanations. It proposes evaluating null rejection, positive acceptance and independently verified consequences together.