IMITATING LANGUAGE VIA SCALABLE INVERSE REINFORCEMENT LEARNING

Summary from the TLDR AI newsletter

Much of modern language modeling is a specific case of imitation learning. Fortunately, there is a depth of study in the field broadly. This paper explores how to use inverse reinforcement learning to imitate entire sequences instead of just tokens. The results are promising and point in the direction of continued RL in language model training pipelines.