TLDR Index
TLDR AI

TLDR AI 2024-10-31

5 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

OPENAI'S NEW HALLUCINATION BENCHMARK

OpenAI has released the SimpleQA benchmark, which measures models' abilities around simple factual questions.

links.tldrnewsletter.com7 min read

EVALUATING FEATURE STEERING: A CASE STUDY IN MITIGATING SOCIAL BIASES

This study explores using feature steering in AI models to interpretably modify outputs. It reveals a "steering sweet spot", where changes do not degrade capabilities. The study results show steering can alter social bias in targeted domains but also brings unexpected off-target effects. Further research is required to refine feature steering for safer, more reliable outcomes in AI models.

anthropic.com17 min read

02RESEARCH & INNOVATION

THUNDERKITTENS 2

Thunder Kittens is a framework for writing extremely performant GPU Kernels. It is built on the idea that GPUs actually want to operate on small 16x16 tiles of data. In turn, the useability is quite high, and 40% faster kernels only take a few hundred lines of code.

links.tldrnewsletter.com17 min read

REALISTIC MOTION RETARGETING

MeshRet has introduced a novel approach for improving motion retargeting for 3D characters that focuses on preserving body geometry interactions from the start.

abcyzj.github.io2 min read

BETTER GENERATION WITH SELF-GUIDANCE SAMPLING

Researchers have enhanced Masked Generative Models (MGMs) with a new self-guidance sampling method, improving their image generation quality while maintaining diversity.

arxiv.org18 min read

03ENGINEERING & RESOURCES

SPEEDING UP TRANSFORMERS WITH TOKEN MERGING

This project introduces PiToMe, an algorithm that compresses Vision Transformers by progressively merging tokens after each layer. This method reduces the number of tokens processed.

github.comGitHub repository

3D RECONSTRUCTION WITHOUT POSE DATA

PF3plat tackles the challenge of pose-free 3D reconstruction and novel view synthesis from RGB images, eliminating the need for extra data.

cvlab-kaist.github.io3 min read

A BENCHMARK FOR EVALUATING DATA CURATION METHODS

SELECT is the first large-scale benchmark for comparing data curation strategies in image classification. ImageNet++ is a new dataset that extends ImageNet-1K with five new training-data shifts, each assembled using different curation techniques.

github.comGitHub repository

04MISCELLANEOUS

FINE-TUNING LLMS TO 1.58BIT: EXTREME QUANTIZATION MADE EASY

BitNet, developed by Microsoft Research, introduces a transformer architecture that reduces LLM computational and memory requirements by using ternary precision (-1, 0, 1) equating to 1.58 bits per parameter. Models are required to be trained from scratch. BitNet can also fine-tune existing models to this low-precision format, maintaining strong performance on downstream tasks. This approach significantly reduces energy consumption and improves inference speed using specialized kernels for efficient matrix multiplication.

huggingface.co24 min read

HOW WE SAVED HUNDREDS OF ENGINEERING HOURS BY WRITING TESTS WITH LLMS

Assembled uses LLMs to accelerate and improve software testing, enabling test generation in minutes instead of hours. This approach increases engineering productivity, saving time and shifting focus to feature development. LLMs generate comprehensive and accurate tests that maintain code quality and development velocity.

assembled.com7 min read

25% OF SMARTPHONE OWNERS DON'T WANT AI AS APPLE INTELLIGENCE DEBUTS

A CNET survey revealed that only 18% of smartphone users are motivated by AI features to upgrade their devices, with privacy and cost being significant concerns. Major manufacturers like Apple, Google, and Samsung are integrating more AI capabilities in their phones, yet many users prioritize battery life and storage over AI functions. AI subscriptions are set to become common, but nearly half of users are unwilling to pay for these features.

cnet.com6 min read