EvalResearchBench: Can AI Agents Build Their Own Feedback for Recursive Self-Improvement?

What this work does

Benchmarks agents that design executable evaluators by selecting tasks, implementing graders, and repairing them through pilots. The best agent-built evaluators approximate target-benchmark rankings but still suffer failures such as truncation and budget exhaustion.