TraceForge: Distilling with Your Own Thinking

What this work does

TraceForge synthesizes reasoning in the student's model-family style while retaining a stronger teacher's answers. Controlled student-training comparisons suggest these synthetic traces can outperform the teacher's original traces on coding tasks.