TLDR Index
TLDR AI

TLDR AI 2023-05-17

6 sections14 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

03RESEARCH & INNOVATION

TINY STORIES, 1 TRANSFORMER BLOCK CAN GENERATE STORIES

With models getting larger and more expensive we generally get better performance. But what happens if we go the other way? It turns out that tiny models can learn to generate coherent, novel, and grammatically correct stories. If you carefully construct the training data set and restrict the vocabulary to common words, you get some compelling completions from these miniscule models.

arxiv.org25 min read

IMPROVING ACTION RECOGNITION: EXPLORING MULTIMODAL GENERALIZATION

This study introduces a new concept in egocentric action recognition called Multimodal Generalization (MMG), which focuses on how systems can adapt when data from certain sources is limited or missing. To investigate this, a new dataset called MMG-Ego4D was created, and new methods were developed to enhance the system's ability to generalize, potentially guiding future research in this area.

arxiv.org9 min read

SUPERICL: MAKING BIG AI MODELS WORK BETTER WITH SMALLER ONES

SuperICL is a new technique that helps massive AI models, like GPT-3 and GPT-4, to learn better by working with smaller, locally fine-tuned models. This approach not only boosts the performance of these big AI models on tasks, but also improves their stability and the abilities of smaller models, such as understanding different languages and explaining their decisions.

arxiv.org6 min read

04ENGINEERING & RESOURCES

REACT HOOK TO RUN LLM IN THE BROWSER

With the advent of WebGPU, you can now run hardware accelerated workflows in the browser. This repository exposes a React hook that downloads the model from the HuggingFace CDN, compiles to WASM, and runs inference.

github.comGitHub repository

GUIDANCE

Guidance enables you to control modern language models more effectively and efficiently than traditional prompting or chaining.

github.comGitHub repository

DIFY

One API for plugins and datasets and one interface for prompt engineering and visual operation, all for creating powerful AI applications.

github.comGitHub repository

05MISCELLANEOUS

THE FIRST RNN ON THE TRANSFORMERS LIBRARY

The RWKV model is a linear attention model with built in recurrence. It is a powerful language model that runs fast with a theoretically long context window. The model development has an active discord community which now is more visible on the HuggingFace platform.

huggingface.co15 min read

THE MOBILE AI RACE

Tech companies are racing to add AI to their mobile devices, however, high computing costs present a significant hurdle.

archive.ph3 min read