TLDR AI

TLDR AI 2023-08-22

5 sections13 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

STABLEVIDEO: EDIT VIDEOS USING DIFFUSION METHODS

While diffusion methods are great for creating images and videos, they have a hard time editing videos without changing how objects look over time. StableVideo uses a special technique to make sure edited objects look consistent throughout a video.

github.comGitHub repository

EARLY DAYS OF AI

This current era of LLMs, Transformers, and diffusion models is completely different from any prior AI period.

blog.eladgil.com5 min read

02RESEARCH & INNOVATION

TOWARDS CREATIVE CHESS WITH ALPHAZERO

Another cool games paper from Deepmind. The researchers try to improve their AlphaZero chess playing agent to reduce hallucination and improve broad creativity. They find that the types of moves it plays are more diverse and can solve really challenging positional puzzles. Interesting to see how it works out long term.

arxiv.org31 min read

ENHANCING CHATBOTS' ROLE-PLAYING ABILITIES

Chatbots that act like fictional characters are gaining popularity, but current methods need refining for better imitation. This study presents a new algorithm using improved prompts and character memories from scripts.

arxiv.org18 min read

03ENGINEERING & RESOURCES

INTRODUCING RLIPV2: A BETTER LANGUAGE-VISION MODEL

RLIPv1 is a method that helps computers connect what they see in images to descriptive words, but it has some problems, especially with being slow and lacking data. This new paper introduces RLIPv2, a faster version that uses a new tool (ALIF) to better merge images and words. It also has a new way to get more descriptive data from images.

github.comGitHub repository

OPENPIPE

OpenPipe is a flexible playground for comparing and optimizing LLM prompts. It lets you quickly generate, test, and compare candidate prompts, and can automatically translate those prompts between models.

github.comGitHub repository

MINIMAL ML FRAMEWORK IN RUST

HuggingFace released a neat little ML framework in Rust that is lightning fast and supports a number of powerful models.

github.comGitHub repository

04MISCELLANEOUS

USING AN RNN FOR 2D GAME TILE SYNTHESIS

A fun blog about creating game assets using a classic AI technique. There are lots of good tidbits here around dataset curation, hyperparameter optimization, and human based evaluation. Could be cool to expand this with SDXL pixel LoRAs and truly synthesize maps from scratch.

voxely.net12 min read

I MADE STABLE DIFFUSION XL SMARTER

In this article, Max Woolf breaks down how he made the newest version of Stable Diffusion better by training it on bad AI-generated images.

minimaxir.com11 min read

WHAT CAN FETISH RESEARCH TELL US ABOUT AI?

There are parallels between human fetish formation and AI alignment challenges, suggesting that understanding how misinterpretations of evolutionary cues lead to fetishes might offer insights into AI generalization problems. The article explores the potential for this analogy to inform AI training and interpretability, acknowledging the differences between biological evolution and AI programming.

astralcodexten.substack.com9 min read