IMPROVING CURSOR TAB WITH RL

Summary from the TLDR AI newsletter

Cursor Tab is a system that predicts users' next actions across their codebase to make suggestions. The Tab model runs on every user action, handing over 400 million requests per day. This has given Cursor a lot of data about which suggestions users accept and reject. Cursor uses this data to improve Tab using online reinforcement learning. Its approach involves rolling out new models to users frequently throughout the day and using that data for training.