Open WorldDiscovery GitHub
← Research library
2024NeurIPS Datasets and Benchmarks

DiscoveryWorld A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Peter Jansen, Marc-Alexandre Côté, Tushar Khot et al.

What this work does

Provides interactive simulated investigations with instrument use, interventions, hypothesis formation and explanatory outputs.

Connection to discovery

A training/evaluation substrate for complete long-horizon investigations with separate process and knowledge measurements.

Evidence

Scorecards distinguish task completion, procedural actions and explanatory knowledge. Separate unit tasks help diagnose navigation and tool-use failures that would otherwise confound discovery scores.

Scope and limitations

Designed scenarios and rules bound the possible discoveries. Action competence and causal understanding can fail independently, and explanatory grading requires an evaluator audit.

THE RESEARCH CONVERSATION

Discussion & reactions

Share a question, an insight, or a replication experience. Sign in with GitHub to join the conversation.

Open GitHub discussions ↗