TLDR Index
TLDR AI

TLDR AI 2024-05-10

6 sections19 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

AI IS ABOUT TO SERIOUSLY DISRUPT HOSPITALITY

If you want to see the future of AI-powered hospitality, look no further than Jurny [4]. And if you want to invest in that future - now's your chance [4].

links.tldrnewsletter.comSponsor

02HEADLINES & LAUNCHES

YELLOW RAISES $5M FOR ASSISTIVE 3D MODELING

A former Google ML Head of Product and an MIT professor have raised money from a16z's new game fund for generative 3D character creation.

links.tldrnewsletter.com4 min read

STABILITY AI DISCORD BOT

Stability AI has introduced Stable Artisan, a system combining all of its models that can be run from Discord. This is likely a play to compete directly with Midjourney.

stability.ai3 min read

ELEVENLABS PREVIEWS MUSIC-GENERATING AI MODEL

Voice AI startup ElevenLabs is previewing a new model that converts prompts into song lyrics. The company is using a promotional strategy similar to the one OpenAI used for Sora AI.

links.tldrnewsletter.com3 min read

03RESEARCH & INNOVATION

CONSISTENCY LANGUAGE MODELS

Predicting more than one token at a time is an interesting paradigm of active research. If successful, it would dramatically improve generation time for many large language models. The approach in this post, which mirrors consistency models from image synthetics, attempts to use a parallel decoding strategy on fine-tuned LLMs to speed up generation. Early results match speculative decoding performance of 3x.

hao-ai-lab.github.io21 min read

YOU ONLY CACHE ONCE

The YOCO architecture is a decoder-decoder model that reduces GPU memory demands while retaining global attention capabilities. It consists of a self-decoder and cross-decoder, allowing for efficient caching and reuse of key-value pairs. YOCO achieves favorable performance compared to traditional Transformers, with significant improvements in inference memory, latency, and throughput, making it suitable for large language models and long context lengths.

arxiv.org25 min read

04ENGINEERING & RESOURCES

BUZZ PRETRAINING DATASET (HUGGING FACE HUB)

Buzz is a novel dataset that includes preference data in the pretraining mix. Its researchers have also released several models that were trained using this data. They found that the models perform well on a number of human preference tasks.

huggingface.co

ACHIEVING FAIRNESS WITH A NEW POST-PROCESSING ALGORITHM

This new post-processing algorithm addresses model bias by applying a "fairness cost" to recalibrate output scores, ensuring compliance with various group fairness criteria such as statistical parity, equal opportunity, and equalized odds.

arxiv.org36 min read

ENHANCED CHANGE DETECTION IN IMAGES

DiffMatch is a novel semi-supervised change detection method that leverages visual language models to synthesize pseudo labels for unlabeled data, providing additional supervision signals.

arxiv.org19 min read

05MISCELLANEOUS

GEMMA 10M CONTEXT

Discussion of the various ways to extend context for language models. It doesn't provide much in the way of evaluations, but it's a fascinating discussion of where the field is exploring.

medium.com6 min read

VISION MAMBA: A COMPREHENSIVE SURVEY

A comprehensive survey that explores Mamba's applications across various visual tasks and its evolving impact. Stay updated on new findings and advancements on the Mamba project.

arxiv.org34 min read