What a difference a year makes! We talked about model collapse and synthetic data more than a year ago. Progress is being made in "taming" this issue with techniques like the ones introduced this week (Dec 12, 2024) by a team of researchers at Microsoft with phi-4. Check it out here: https://arxiv.org/pdf/2412.08905v1
What a difference a year makes! We talked about model collapse and synthetic data more than a year ago. Progress is being made in "taming" this issue with techniques like the ones introduced this week (Dec 12, 2024) by a team of researchers at Microsoft with phi-4. Check it out here: https://arxiv.org/pdf/2412.08905v1
Happy Holidays!