Open WorldDiscovery GitHub
← Research library
2025NeurIPS

TTRL: Test-Time Reinforcement Learning

Yuxin Zuo, Kaiyan Zhang, Li Sheng et al.

What this work does

Estimates labels by majority agreement among sampled answers, then uses agreement-based rewards for RL on otherwise unlabeled test questions.

Connection to discovery

A useful self-consistency baseline when external labels are unavailable.

Evidence

The reward pseudocode and implementation disclose response counts, sampling and separate benchmark adaptation, making the available feedback and compute budget explicit.

Scope and limitations

Consensus is not truth and can amplify shared misconceptions. It cannot certify novel causal claims; adaptation also consumes the test distribution, so its protocol differs from frozen-model evaluation.

THE RESEARCH CONVERSATION

Discussion & reactions

Share a question, an insight, or a replication experience. Sign in with GitHub to join the conversation.

Open GitHub discussions ↗