Why Cherry-Picking Your Best Data Can Kill Generalisation
Data selection for fine-tuning in a self-training loop: training on the best data collapsed in our 13-generation study, while recent data kept improving.
Data selection for fine-tuning in a self-training loop: training on the best data collapsed in our 13-generation study, while recent data kept improving.