Open WorldDiscovery GitHub
← Research library
2025Findings of EMNLP

Agent Laboratory: Using LLM Agents as Research Assistants

Samuel Schmidgall, Yusheng Su, Ze Wang et al.

What this work does

Specialized agents perform literature review, experimentation and report writing, with optional human feedback and a pool of scored experimental programs.

Connection to discovery

Shows how successful and failed execution feedback can be captured separately from the final report for training data collection.

Evidence

Inspected the solver's execution/reflection loop and report-review mechanism, including its discussion of unhelpful experimental outputs.

Scope and limitations

Human-provided ideas and intermediate guidance affect autonomy. LLM-generated scientific scores need independent measurement and cannot substitute for held-out experimental evaluation.

THE RESEARCH CONVERSATION

Discussion & reactions

Share a question, an insight, or a replication experience. Sign in with GitHub to join the conversation.

Open GitHub discussions ↗