The Daily Index — Wednesday, July 10, 2024 · TLDR Index

RESEARCH & INNOVATION

TLDR AI

TLDR AI

DISTILLING SYSTEM 2 INTO SYSTEM 1

System 2 models are those that use something like Chain of Thought to spend more test time compute and improve reasoning. It turns out that you can distill this behavior into a System 1 model that runs faster with similar accuracy.

arxiv.org · 23 min

TLDR AI

LEARNING AT TEST TIME

A new RNN variant that outperforms Mamba on a number of tasks. Importantly, the update function is itself an ML model - which enables long contexts and in-context learning.

arxiv.org · 25 min

TLDR AI

See how it works: register for the live session on July 24 →

Summary unavailable

bit.ly

TLDR AI

TINYGRAD NOTES

Tinygrad is a toolkit for training deep learning models. This set of notes is a great introduction for AI compilers and prepares one for a deep dive into Tinygrad internals.

mesozoic-egg.github.io · 18 min

TLDR AI

POP CULTURE

Goldman Sachs released a critical 31-page report titled "Gen AI: Too Much Spend, Too Little Benefit?", arguing that generative AI's productivity benefits and returns are significantly limited and that its power demands will drastically increase utility spending. The report highlights doubts about AI's ability to transform industries, pointing out high costs, power grid challenges, and lack of clear productivity gains or significant revenue generation. It suggests a potentially bleak future for the technology without major breakthroughs.

wheresyoured.at · 18 min

TLDR AI

4D OCCUPANCY GENERATION FOR DRIVING SCENES

OccSora is a diffusion-based 4D occupancy generation model designed to improve long-term temporal evolutions.

wzzheng.net · 3 min

TLDR AI

KRUT AI (PRODUCT LAUNCH)

Krut AI is an AI co-pilot built for e-commerce that helps with product shots and content creation.

producthunt.com