LEARNING TO MODEL THE WORLD WITH LANGUAGE

Summary from the TLDR Dev newsletter

Dynalang is an agent that learns to understand and uses multiple types of language by predicting future text, images, and rewards within a multimodal world model.