TLDR AI 2023-03-20

TRAIN A CHATGPT COMPETITOR FOR $85K AND RUN IT IN YOUR BROWSER

MIDJOURNEY V5 IS HERE!

COMPREHENSIVE PROMPT ENGINEERING

RESIDUAL CONNECTION IN TRANSFORMERS HAS A PRIVILEGED BASIS

COLT5: LONG-INPUT TRANSFORMER MODEL WITH CONDITIONAL COMPUTATION

The article presents COLT5, a new long-input Transformer model that uses conditional computation to allocate more resources to important tokens, achieving state-of-the-art results on the long-input SCROLLS benchmark with faster training and inference, and effective processing of extremely long inputs.

ALPACA LORA

Low Rank Adaptation is a method to fine-tune language models by updating only a small subset of the parameters. This repo contains code that assists in tuning the popular Llama models via instruction tuning on consumer hardware due to the reduced computational requirements of Lora.

ML COMMANDS

A list of extremely useful commands for ML research from a HuggingFace research scientist. It includes things like distributed training, environment set up, and configuration tasks. A useful reference for any practitioner.

GLUEGEN: EFFICIENTLY UPGRADING TEXT-TO-IMAGE MODELS WITH GLUENET

The article proposes GlueGen, a method that aligns features from different encoders with the latent space of an existing text-to-image (T2I) model using the GlueNet model and a new training objective. This allows for efficient integration of new functionality, such as multilingual language models and multi-modal encoders, into existing T2I models, enabling sound-to-image generation and upgrading the current text encoder for challenging case generation.

KHAN ACADEMY AND OPENAI

Khan Academy is a nonprofit that offers thousands of lessons in math, science and the humanities for students of all ages. Khan Academy announced that it will use GPT-4 to power Khanmigo, an AI-powered assistant that functions as both a virtual tutor for students and a classroom assistant for teachers. The nonprofit began testing the newest version of OpenAI’s language model in 2022 and will initially make the Khanmigo pilot program available to a limited number of participants, though the public is invited to join the waitlist.

SAM ALTMAN IS A BIT SCARED OF AI

VOICE CLONING AI LET’S YOU SPEAK MULTIPLE LANGUAGES

VALL-E X, a new AI model from Microsoft, can clone a voice from a short sample of 4-10 seconds and then use it to synthesize speech in a different language.

GM WANTS TO BRING CHATGPT-LIKE ASSISTANT TO DRIVERS

GGML

Ggml is a tensor library for machine learning.