GENERATE IMAGES WITH A LANGUAGE MODEL

Summary from the TLDR AI newsletter

Multimodal training of more than one data type has been gaining popularity recently. Usually, the model architecture requires complicated and somewhat brittle solutions. Gill is a cool new project that interleaves text tokens with image tokens to allow for truly multimodal input and output. The reported results are compelling although there are still limitations.