Open WorldDiscovery GitHub

THE RESEARCH LIBRARY

A field, connected.

Browse 152 works across eight questions in Open World Discovery.

Download BibTeX ↗

Eight research questions. One connected discovery process.

152 works

AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning

Zhiheng Xi, Jixuan Huang, Chenyang Liao et al.

Decouples agent execution, environments and RL components, and increases the allowed interaction horizon in stages to balance early exploitation and later exploration.

Discovery relevance

A training infrastructure baseline for horizon curricula and controlled comparisons across discovery environments.

Causal Discovery in the Era of Agents

Yujia Zheng, Vishal Verma, Mantej Gill et al.

Advocates keeping causal claims tied to explicit assumptions, data and formal algorithms while agents assist data inspection, method selection and interpretation.

Discovery relevance

A clear counterpoint to LLM-generated causal edges and a useful provenance contract for scientific harnesses.

CausalSteward: An Agentic Divide-Conquer-Combine Copilot for Causal Discovery

Nicholas Tagliapietra, Gian Lorenzo Marchioni, Moritz Willig et al.

Partitions high-dimensional variables, combines LLM/human prior knowledge with data-driven discovery in local graphs, and merges results through hypothesis/critic agents.

Discovery relevance

Exposes a testable boundary between domain-knowledge proposals, statistical tests and final graph commitments in a harness.

Discovery Foundation Models: Toward Open-Ended Discovery Intelligence

Ling Yang, Zhenfei Yin, Yingcheng Wu

Defines discovery foundation-model systems through revisable research states and seven coupled capabilities, with state-conditioned operations, experimental gating and validated cross-task discovery skills.

Discovery relevance

Connects problem discovery, representation construction, experiments, verification and learning as one discovery-system agenda.

DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses

Jianyuan Zhong, Chenwei Wu, Zhaochen Yu et al.

Evolves evidence-grounded hypothesis trees, compiles investigations into executable tasks, and reuses research histories through contribution credit, harness replay and subsequent rediscovery rounds.

Discovery relevance

Connects learned hypothesis development, executable research workflows and cumulative improvement of discovery procedures.

HarnessTTT: Learn to Optimize Harness at Test-Time for Scientific Discovery

Yingzi Ma, Yulong Cao, Nanxi Li et al.

Trains a harness proposer at test time while keeping the executor fixed; generated prompts, skills and execution controls guide budgeted discovery rollouts whose feedback updates proposer weights.

Discovery relevance

A direct test-time learning mechanism for improving the procedure used to search for discoveries.

Hyperagents

Jenny Zhang, Bingchen Zhao, Wannan Yang et al.

Integrates task solving and meta-level modification into one editable program, allowing archived agents to change both task behavior and the procedure that generates future modifications.

Discovery relevance

Makes the improvement procedure itself an experimental object for recursive discovery-system development.

Into the Unknown: Benchmarking AI agents on open scientific research problems

Seungone Kim, Jiayi Geng, Young-Jun Lee et al.

Fifteen author-proposed, unpublished follow-up directions supply original papers, code, datasets, and task specifications. Agents submit a follow-up paper, code, and execution logs. Expert-verified direction-specific and integrity rubrics are graded by an agentic judge, separating integrity, completeness, and sufficiency. The main metric requires all three strict gates.

Discovery relevance

A concrete evaluation protocol for pursuing open scientific problems without a reference solution, with executable artifacts and evidence traceability. The primary contribution is a benchmark and evaluation method, so it belongs in Discovery Evaluation.

Learning to Discover at Test Time

Mert Yuksekgonul, Daniel Koceja, Xinhao Li et al.

Learns during a single target problem using a tail-emphasizing entropic reward objective and state reuse that favors promising candidates while preserving exploration.

Discovery relevance

Distinguishes producing one exceptional verified artifact from maximizing average answer quality, and makes test-instance-specific policy learning explicit.

Reimagining research papers as interactive and reliable AI agents

Jiacheng Miao, Joe R. Davis, Yaohui Zhang et al.

Converts a paper and its code into an executable MCP server using environment setup, tutorial execution, reusable tool extraction, iterative testing and server assembly; the scientific LLM consumes the resulting tools, resources and prompts.

Discovery relevance

A concrete example of improving the discovery harness and reusable scientific tools without updating base-model weights. It motivates controlled model-by-harness ablations and checks of execution fidelity versus scientific validity.

Self-Evolving Coding Agents via Harness-Policy Optimization

Zhepei Wei, Wenlin Yao, Baolin Peng et al.

Alternates harness search proposed by the current policy with RL updates under the selected harness, carrying hard tasks and failure evidence into subsequent rounds.

Discovery relevance

A concrete co-evolution mechanism for jointly improving discovery policies and the harness that elicits their trajectories.

A Self-Improving Coding Agent

Maxime Robeyns, Martin Szummer, Laurence Aitchison

Uses an evaluated archive to select a coding agent that edits its own implementation, tools and oversight mechanisms, retaining changes according to downstream benchmark utility.

Discovery relevance

An enabling example of improving the executable discovery harness through evaluated self-modification.

2025NeurIPS SEA WorkshopDiscovery Evaluation

BoxingGym: Benchmarking Progress in Automated Experimental Design and Model Discovery

Kanishk Gandhi, Michael Y. Li, Lyle Goodyear et al.

Lets a scientist agent query a hidden probabilistic world, revise a model and communicate an explanation to a novice whose predictions evaluate that explanation.

Discovery relevance

A useful decomposition of evidence acquisition, model quality and reusable communication, rather than scoring only a final answer.

Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents

Patrick Tser Jern Kon, Jiachen Liu, Qiuyi Ding et al.

Architect/technician agents interact through modules that validate experimental procedures, partition plans, enforce dependencies and retain structured experiment knowledge.

Discovery relevance

A concrete harness contribution: experimental control and provenance can be evaluated independently of policy parameter updates.

LLM-SR: Scientific Equation Discovery via Programming with Large Language Models

Parshin Shojaee, Kazem Meidani, Shashank Gupta et al.

A frozen LLM proposes executable equation skeletons; numerical optimization fits constants, and scored programs are retained in a clustered experience buffer for iterative refinement.

Discovery relevance

A useful frozen-policy baseline against which to measure whether RL actually improves equation search efficiency or generalization.

LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

Parshin Shojaee, Ngoc-Hieu Nguyen, Kazem Meidani et al.

Combines transformed known equations and synthetic scientific terms to reduce simple formula recitation, evaluating both data fidelity and symbolic agreement.

Discovery relevance

Separates memorized scientific priors from fitting less familiar mechanisms and motivates hidden mechanism families in discovery evaluation.

OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Code

Maxence Faldor, Jenny Zhang, Antoine Cully et al.

Uses language/vision models to generate task descriptions and executable environments, train agents, and retain learned/failed tasks in an evolving archive.

Discovery relevance

A concrete model for generating discovery-training worlds and curricula from a persistent record of competence and failures.

RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning

Zihan Wang, Kangrui Wang, Qineng Wang et al.

Trains multi-turn trajectories with state, reasoning, action and reward records; analyzes collapsed within-group reward variance and stabilizes updates with filtering and critic-related changes.

Discovery relevance

Useful for measuring whether exploration diversity and reward variance survive long discovery rollouts.

Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning

Bowen Jin, Hansi Zeng, Zhenrui Yue et al.

Optimizes search-interleaved LLM rollouts with PPO/GRPO and masks externally returned retrieval tokens from policy optimization.

Discovery relevance

A practical precedent for training tool selection from terminal rewards while respecting which trajectory tokens were actually generated by the policy.

2025Nature Machine IntelligenceDiscovery Evaluation

The Causal Chambers: Real Physical Systems as a Testbed for AI Methodology

Juan L. Gamella, Jonas Peters, Peter Bühlmann

Uses computer-controlled physical chambers with actuators and sensors to generate heterogeneous datasets and interventions over well-characterized systems.

Discovery relevance

A bridge between inexpensive synthetic discovery and controlled physical experimentation with known mechanisms.

The Surprising Effectiveness of Test-Time Training for Few-Shot Learning

Ekin Akyürek, Mehul Damani, Adam Zweiger et al.

Builds temporary adaptation data from few-shot demonstrations, with leave-one-out tasks and domain-specific transformations, then combines updated weights with prediction aggregation.

Discovery relevance

Suggests testing whether task-local examples support a useful inner-loop objective before introducing a complex RL adaptation policy.

WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning

Zehan Qi, Xiao Liu, Iat Long Iong et al.

Uses unsuccessful web attempts to generate new curriculum instructions, learns an outcome reward model and controls update drift while reusing trajectory data.

Discovery relevance

A data-collection pattern for training from failures while tracking environment feedback and task difficulty.

2024Findings of ACLDiscovery Training

AgentTuning: Enabling Generalized Agent Abilities for LLMs

Aohan Zeng, Mingdao Liu, Rui Lu et al.

Collects teacher-model interaction trajectories, filters by task reward and mixes accepted agent demonstrations with general-domain instructions for supervised tuning.

Discovery relevance

A concrete data-collection and SFT baseline before RL, with explicit environment transcripts and retention controls.

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality

Emre Kıcıman, Robert Ness, Amit Sharma et al.

Behaviorally probes language models on multiple causal tasks and discusses connecting text-based prior knowledge with statistical and logical causal methods.

Discovery relevance

Useful for defining which parts of causal reasoning can be elicited from pretrained knowledge and which require new data or intervention evidence.

2024NeurIPS Datasets and BenchmarksDiscovery Evaluation

DiscoveryWorld A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Peter Jansen, Marc-Alexandre Côté, Tushar Khot et al.

Provides interactive simulated investigations with instrument use, interventions, hypothesis formation and explanatory outputs.

Discovery relevance

A training/evaluation substrate for complete long-horizon investigations with separate process and knowledge measurements.

A Meta-Reinforcement Learning Algorithm for Causal Discovery

Andreas Sauter, Erman Acar, Vincent François-Lavet

Trains a recurrent policy across synthetic SCMs to choose budgeted interventions and edit an explicit graph estimate, rewarded by terminal graph accuracy and an intervention bonus.

Discovery relevance

Directly demonstrates that a discovery training problem can learn experiment selection and belief/graph updating jointly, beyond learning a representation alone.

An autonomous laboratory for the accelerated synthesis of inorganic materials

Nathan J. Szymanski, Bernardus Rendy, Yuxing Fei et al.

Combines literature-trained recipe proposals, robotic synthesis, XRD interpretation and thermodynamics-guided active learning to revise unsuccessful recipes.

Discovery relevance

A prospective physical discovery loop and a direct example of failed experiments serving as evidence for choosing the next experiment.

2023Philosophical Transactions of the Royal Society ADiscovery Representations

DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning

Kevin Ellis, Catherine Wong, Maxwell Nye et al.

Alternates solving tasks, compressing found programs into reusable library abstractions, and training a recognition model on replayed and generated tasks.

Discovery relevance

Separates improving a representation language from improving search within that language, making representation growth an explicit learning target.

Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl

Miles Cranmer

Asynchronous expression populations combine mutation, crossover, age regularization, migration, simplification and continuous constant optimization under accuracy/complexity tradeoffs.

Discovery relevance

A strong non-LLM search baseline and a concrete example of how a representation grammar and an optimizer jointly determine what can be discovered.

Learning to Induce Causal Structure

Nan Rosemary Ke, Silvia Chiappa, Jane Wang et al.

A transformer maps observational/interventional datasets to an autoregressive distribution over graph adjacency entries, trained on synthetic graph/data pairs.

Discovery relevance

A learned inference baseline that separates recovering structure from selecting which intervention data to acquire.

A Unified Framework for Deep Symbolic Regression

Mikel Landajuela, Chak Shing Lee, Jiachen Yang et al.

Combines recursive problem simplification, neural-guided search, large-scale pretraining, genetic programming and linear-model tokens in one modular symbolic-regression system.

Discovery relevance

A strong precedent for training a prior across problems and adapting search to a new discovery instance; useful for decomposing gains from model training and search harnesses.

Discovering faster matrix multiplication algorithms with reinforcement learning

Alhussein Fawzi, Matej Balog, Aja Huang et al.

An AlphaZero-style policy/value network guides tensor-decomposition search; training combines played games, synthetic factorization demonstrations and problem symmetries.

Discovery relevance

A direct discovery-RL precedent showing how to obtain valid synthetic training instances when generating solutions is easier than solving the forward problem.

Interventions, Where and How? Experimental Design for Causal Models at Scale

Panagiotis Tigas, Yashas Annadani, Andrew Jesson et al.

Combines posterior uncertainty over graphs and mechanisms with information-based acquisition, selecting both intervention targets and values. Greedy and soft batch selection trade acquisition quality against computation.

Discovery relevance

A baseline for the experiment-action space: choosing what to manipulate and by how much are separate decisions.

STaR: Bootstrapping Reasoning With Reasoning

Eric Zelikman, Yuhuai Wu, Jesse Mu et al.

Iteratively generates rationales and fine-tunes on correct answers; rationalization conditions on known answers to recover additional training examples.

Discovery relevance

A reasoning-training comparison for success-filtered self-training, especially when contrasting known-answer tasks with discovery lacking answer labels.

2022AAAI Spring Symposium SeriesContinual Discovery

Self-Initiated Open World Learning for Autonomous AI Agents

Bing Liu, Eric Robertson, Scott Grigsby et al.

Organizes autonomous learning around novelty detection, characterization, self-initiated data gathering, adaptation and continual incorporation of knowledge through human and environment interaction.

Discovery relevance

A direct conceptual foundation for agents that initiate investigations and learn from unknowns during deployment.

Weakly supervised causal representation learning

Johann Brehmer, Pim de Haan, Phillip Lippe et al.

Uses paired observations before/after unknown interventions to learn latent causal variables and mechanisms, with explicit and implicit causal-model parameterizations.

Discovery relevance

A precise precedent for representation-level discovery with weak experimental supervision, rather than treating every new embedding as a discovered variable.

Deep Adaptive Design Amortizing Sequential Bayesian Experimental Design

Adam Foster, Desi R Ivanova, Ilyas Malik et al.

Optimizes a design policy over entire experimental histories using sequential contrastive lower bounds on information gain. History pooling supports fast adaptive design after upfront training.

Discovery relevance

A direct precedent for learning experiment selection rather than merely solving a fixed question, with train-time amortization and test-time evidence gathering separated.

Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients

Brenden K. Petersen, Mikel Landajuela, T. Nathan Mundhenk et al.

An autoregressive recurrent policy emits expression trees and is optimized using the conditional reward of samples above a reward quantile.

Discovery relevance

Direct precedent for optimizing the best discovered result rather than average rollout reward; important when comparing discovery RL with ordinary task-solving RL.

Symbolic Regression via Deep Reinforcement Learning Enhanced Genetic Programming Seeding

T. Nathan Mundhenk, Mikel Landajuela, Ruben Glatt et al.

Uses a recurrent expression generator to seed short genetic-programming runs and trains the generator using its own samples plus selected high-performing evolved expressions.

Discovery relevance

Shows how trajectories or candidates improved by a non-neural search process can become training data for a discovery proposal policy.

2021Proceedings of the IEEEDiscovery Representations

Towards Causal Representation Learning

Bernhard Schölkopf, Francesco Locatello, Stefan Bauer et al.

Connects structural causal models, independent mechanisms and sparse distribution changes to the problem of learning causal variables from low-level observations.

Discovery relevance

Makes variable construction and mechanism learning distinct research targets; the representation is part of the discovery problem.

A Review of Open-World Learning and Steps Toward Open-World Learning Without Labels

Mohsen Jafarzadeh, Akshay Raj Dhamija, Steve Cruz et al.

Formalizes open-world learning with and without labels, connecting novelty detection, clustering, instance management and incremental recognition in a modular learner.

Discovery relevance

Provides foundational vocabulary and evaluation distinctions for learning unknown categories and managing accumulated knowledge.

Enhanced POET: Open-Ended Reinforcement Learning through Unbounded Invention of Learning Challenges and their Solutions

Rui Wang, Joel Lehman, Aditya Rawal et al.

Maintains a population of paired environments and agents, mutating challenges and transferring solutions, with a behavioral characterization separated from the environment encoding.

Discovery relevance

A curriculum-generation baseline in which stepping stones and transfer can produce tasks that a linear difficulty schedule misses.

Joint Causal Inference from Multiple Contexts

Joris M. Mooij, Sara Magliacane, Tom Claassen

Pools datasets while explicitly representing their contexts as variables, then supplies context-to-system background constraints to suitable causal-discovery algorithms.

Discovery relevance

Provides a representation for accumulated experiments with heterogeneous interventions rather than treating all samples as exchangeable observational data.

VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning

Luisa Zintgraf, Kyriacos Shiarlis, Maximilian Igl et al.

Learns a trajectory encoder and generative decoder for a posterior over task embeddings, then conditions a policy on that uncertainty to optimize online adaptation return.

Discovery relevance

A baseline for evaluating the value of information through later task performance while keeping posterior inference and action selection explicit.

Causal Reasoning from Meta-reinforcement Learning

Ishita Dasgupta, Jane Wang, Silvia Chiappa et al.

Meta-trains a recurrent policy to gather information before a rewarded causal query, with within-episode adaptation carried by recurrent state rather than new weight updates.

Discovery relevance

A concrete training formulation for choosing informative interventions and using their results to answer later causal questions.

Hindsight Experience Replay

Marcin Andrychowicz, Filip Wolski, Alex Ray et al.

Replays failed goal-conditioned trajectories against alternative goals that their achieved states satisfy, recomputing the corresponding reward.

Discovery relevance

Inspires reuse of failed experiments as evidence for a different, explicitly stated target.

2016JRSS Series BDiscovery Representations

Causal inference using invariant prediction: identification and confidence intervals

Jonas Peters, Peter Bühlmann, Nicolai Meinshausen

Tests whether a target's conditional predictive relationship is invariant across environments and intersects accepted predictor sets to obtain conservative causal statements.

Discovery relevance

A way to ask agents for mechanisms that survive environment changes rather than explanations that only fit one dataset.

Towards Open World Recognition

Abhijit Bendale, Terrance Boult

Formalizes recognition with unknown rejection and subsequent category incorporation, deriving bounded open-space-risk conditions and a Nearest Non-Outlier classifier that supports incremental updates.

Discovery relevance

An early operational foundation for detecting unknowns and extending an agent's recognized knowledge over time.

Causal Discovery with Continuous Additive Noise Models

Jonas Peters, Joris M. Mooij, Dominik Janzing et al.

Uses independence between causes and additive noise to identify causal direction under restrictions; RESIT searches for sinks by regression-residual independence and then removes unnecessary edges.

Discovery relevance

Demonstrates why observational discovery can work only after a mechanism-family assumption adds information beyond conditional independence.

2009ABiALS 2008, LNCS 5499Discovery Foundations

Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

Jürgen Schmidhuber

Intrinsic reward compares old and improved compressors on the same accumulated data; the controller seeks expected future compression progress. The appendix separates compression length, runtime cost and delayed compressor-improvement feedback.

Discovery relevance

A candidate discovery objective is improvement in an agent-relative explanatory code, not novelty or prediction error alone.

2005Advances in Minimum Description Length (MIT Press)Discovery Foundations

A tutorial introduction to the minimum description length principle

Peter Grünwald

Contrasts two-part description length with refined universal coding and normalized maximum likelihood, exposing model-complexity costs that depend on a specified model family.

Discovery relevance

Provides an explicit fit-versus-complexity objective for candidate explanations, and a way to discuss changes in an effective hypothesis language.