TLDR AI · RESEARCH & INNOVATION

SOLVE HARD PROBLEMS TRAINING ON EASY DATA

arxiv.org12 min read

Summary from the TLDR AI newsletter

Hard problems have been thought to require hard data, but that data is hard to label and noisy. This work shows that fine-tuning models on related, but easy, data dramatically improves their generation capabilities on hard problems. Another data point to support fine-tuning as eliciting knowledge instead of adding knowledge.