ALIGNING TINY STORIES MODELS

Summary from the TLDR AI newsletter

Reinforcement learning is probably the best tool for aligning large language models today (and even vision models). However, it is challenging when you need a bunch of human data to train a reward model. What if you can just “use prompting”? This is another great example of a trend of RLCF - C for computational.