ANATOMY OF A MODERN FINETUNING API

Summary from the TLDR AI newsletter

Mira Murati's AI lab, Thinking Machines, has released a language model fine-tuning API called Tinker. Tinker exposes a handle of very low-level functions to users to let them perform supervised fine-tuning and online reinforcement learning. Each training step requires sending a batch of data over the network. It offers a stable, mature infrastructure for RL and fine-tuning experiments, making it possible for anyone to be an AI researcher.