Model collapse is going to arrive pretty soon:

https://www.youtube.com/watch?v=WUFL47UwyNQ

Source: https://arxiv.org/abs/2501.07238 (which I'm hoping will be a good read)

Mastodon Source 🐘