Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

MOSAICBERT: A BIDIRECTIONAL ENCODER OPTIMIZED FOR FAST PRETRAINING

BERT is an Encoder-only Transformer. This means it is often used to represent natural language in the form of embeddings and isn’t usually used to generate text. Importantly, it was one of the first Transformers used in search because it can represent both the query and the information to be retrieved. The team at Mosaic has integrated FlashAttention, GLU, and many other innovations to dramatically improve pretraining speed (1 hour, $20) while matching the performance of much larger traditional BERT models.

A RECAP OF CONSUMER AI IN 2023

This thread provides a recap of AI products and trends that hit the mainstream in 2023. It goes through product launches month by month, providing user numbers and other relevant metrics. Highlights include ChatGPT reaching 100 million monthly active users in January, Balenciaga Pope going viral with 28 million views in March, AI covers taking off in June, users getting roasted by TikTok's AI memes in August, and X's Grok launching in December.

TLDR IndexPage 3