TLDR AI 2023-04-18

TRUTH-SEEKING AI’

DATASET RELEASED TO REPRODUCE LLAMA TRAINING

The Llama models from Meta are powerful but unusable for many commercial applications due to licensing restrictions. However, because they’re so good, lots of folks have been building on top of them. It starts to get tricky when people go to deploy them, however, and often it is a complete impossibility. In the Llama paper they describe the training mix proportions which have now been reproduced as a 1.2 Trillion token dataset. Open models are coming soon.

AI READINESS REPORT

56%-72% of companies have accelerated their AI plans because of the recent generative AI progress. Many of these groups prefer to use open source technology, while OpenAI's APIs are the dominant closed models being used. The report outlines industries adopting AI technologies and good things to know to help cut through the hype.

WITH TEXT

Multimodal C4 (mmc4) is a publicly available dataset that augments the text-only c4 corpus with interleaved images, supporting in-context vision and language models like Flamingo. The dataset, created using a linear assignment algorithm with CLIP features, covers everyday topics and contains 103M documents, 585M images, and 43B English tokens, with 90% of images being topically relevant.

INSTRUCTION TUNING WITH GPT-4

Utilizing GPT-4-generated instruction-following data for LLaMA finetuning, researchers achieve superior zero-shot performance on new tasks in both English and Chinese, surpassing previous state-of-the-art models. This breakthrough is accompanied by comprehensive evaluation and reward model training, with the data and codebase made publicly available.

CEREBRAS-GPT: EFFICIENT, SCALABLE LANGUAGE MODELS WITH OPEN COMPUTE

Cerebras-GPT, a family of compute-optimal language models, demonstrates state-of-the-art training efficiency on pre-training and downstream objectives by leveraging advances in efficient pretraining, scaling, and Maximal Update Parameterization. As the first open and reproducible work comparing compute-optimal model scaling, pre-trained models and code are publicly released.

INPAINT ANYTHING

Inpaint Anything (IA) is a new mask-free image inpainting paradigm that combines various models to create a powerful and user-friendly solution for inpainting tasks. IA offers three main features: Remove Anything, Fill Anything, and Replace Anything, allowing users to edit images using clicks and text-based prompts seamlessly.

SOUNDINI: SOUND-GUIDED DIFFUSION FOR NATURAL VIDEO EDITING

MULTILINGUAL TEXT2IMAGE MODEL

A nice new text to image model that can handle multiple languages. The output is high quality as it was trained on LAION HighRes and an internal proprietary dataset of images. It doesn’t work with diffusers, but they have an online demo. It seems to have more parameters than stable diffusion but might be smaller than the new XL model in the works.

DATA SCIENTISTS CLONES HIS GROUP CHAT

DOLLY IS A “REALLY BIG DEAL”

HYPE GROWS OVER “AUTONOMOUS” AI AGENTS

AI FUNCTIONS

An easy-to-use implementation of AI functions using OpenAI's GPT-4 (or any other model version) to perform various tasks.