Open WorldDiscovery GitHub
← Research library
2017NeurIPS

Hindsight Experience Replay

Marcin Andrychowicz, Filip Wolski, Alex Ray et al.

What this work does

Replays failed goal-conditioned trajectories against alternative goals that their achieved states satisfy, recomputing the corresponding reward.

Connection to discovery

Inspires reuse of failed experiments as evidence for a different, explicitly stated target.

Evidence

The algorithm assumes a mapping from achieved states to valid goals; manipulation tasks provide a concrete setting where that assumption is meaningful.

Scope and limitations

An alternative scientifically meaningful question and its verifier must actually exist. Goal relabeling does not make a failed original hypothesis true, and naive relabeling can be biased under stochastic dynamics.

THE RESEARCH CONVERSATION

Discussion & reactions

Share a question, an insight, or a replication experience. Sign in with GitHub to join the conversation.

Open GitHub discussions ↗