TLDR AI 2023-10-02

META QUIETLY UNVEILS LLAMA 2 LONG

SHOPIFY AI FOR PRODUCT PHOTO CREATION

AI AND JOBS

VISION TRANSFORMERS NEED REGISTERS

One of the coolest and simplest vision papers in recent weeks. Vision Transformers use "useless" pixel values as places to store global information. This makes attention maps uninterpretable. However, if you add a simple [reg] token to the vocabulary, the model will use it and won't store information in pixel values.

TRANSFORMER-VQ: EFFICIENT LINEAR-TIME ATTENTION

This study presents Transformer-VQ, a new design of transformer that processes attention faster thanks to unique vector-based keys and caching.

IDENTIFYING REAL VS FAKE FACES

This study uses visual and language-based tools to improve how systems recognize real vs. fake faces.

LOCAL LLMS MADE EASY

With all the new models coming out, it can be somewhat challenging to find a way to pull and run them. It's also hard to remix and remake them easily. This neat little tool, Ollama, makes it easy to test the latest models.

CREATING VIDEOS FROM SOUND

SAPIENTML

SapientML is an AutoML technology that can learn from a corpus of existing datasets and their human-written pipelines and efficiently generate a high-quality pipeline for a predictive task on a new dataset.

SNOWFLAKE, PINECONE, AND AI21 LABS

PERHAPS AI IS MODERN ALCHEMY

GETTY MADE AN AI GENERATOR TRAINED ON ITS LICENSED IMAGES