Collapse or thrive? Perils and promises of synthetic data in a self-generating world

Joshua Kazdan, Rylan Schaeffer, Apratim Dey, Matthias Gerstgrasser, Rafael Rafailov, David L Donoho, Sanmi Koyejo

arXiv preprint Under Review

October 2024

Model Collapse Synthetic Data Language Models Survey

arXiv

Summary

Clarifying and unifying the literature on perils and promises of synthetic data.