TLDR AI · RESEARCH & INNOVATION
SOLVE HARD PROBLEMS TRAINING ON EASY DATA
Summary from the TLDR AI newsletter
Hard problems have been thought to require hard data, but that data is hard to label and noisy. This work shows that fine-tuning models on related, but easy, data dramatically improves their generation capabilities on hard problems. Another data point to support fine-tuning as eliciting knowledge instead of adding knowledge.