META'S FLAT FOR MULTIMODAL UNDERSTANDING AND GENERATION

Summary from the TLDR AI newsletter

Meta AI introduced FLAT, a method that converts images and text into the same flexible-length sequence of continuous tokens for retrieval and generation. Nested dropout arranges information from coarse to fine, letting models trade computation for visual detail by varying the number of tokens used.