The Daily Index — Thursday, October 31, 2024

HEADLINES & LAUNCHES

TLDR AI

OPENAI'S NEW HALLUCINATION BENCHMARK

OpenAI has released the SimpleQA benchmark, which measures models' abilities around simple factual questions.

links.tldrnewsletter.com · 7 min

TLDR AI

EVALUATING FEATURE STEERING: A CASE STUDY IN MITIGATING SOCIAL BIASES

This study explores using feature steering in AI models to interpretably modify outputs. It reveals a "steering sweet spot", where changes do not degrade capabilities. The study results show steering can alter social bias in targeted domains but also brings unexpected off-target effects. Further research is required to refine feature steering for safer, more reliable outcomes in AI models.

anthropic.com · 17 min

TLDR AI

THUNDERKITTENS 2

Thunder Kittens is a framework for writing extremely performant GPU Kernels. It is built on the idea that GPUs actually want to operate on small 16x16 tiles of data. In turn, the useability is quite high, and 40% faster kernels only take a few hundred lines of code.

links.tldrnewsletter.com · 17 min

TLDR AI

REALISTIC MOTION RETARGETING

MeshRet has introduced a novel approach for improving motion retargeting for 3D characters that focuses on preserving body geometry interactions from the start.

abcyzj.github.io · 2 min

TLDR AI

BETTER GENERATION WITH SELF-GUIDANCE SAMPLING

Researchers have enhanced Masked Generative Models (MGMs) with a new self-guidance sampling method, improving their image generation quality while maintaining diversity.

arxiv.org · 18 min

TLDR AI

3D RECONSTRUCTION WITHOUT POSE DATA

PF3plat tackles the challenge of pose-free 3D reconstruction and novel view synthesis from RGB images, eliminating the need for extra data.

cvlab-kaist.github.io · 3 min

TLDR AI

FINE-TUNING LLMS TO 1.58BIT: EXTREME QUANTIZATION MADE EASY

BitNet, developed by Microsoft Research, introduces a transformer architecture that reduces LLM computational and memory requirements by using ternary precision (-1, 0, 1) equating to 1.58 bits per parameter. Models are required to be trained from scratch. BitNet can also fine-tune existing models to this low-precision format, maintaining strong performance on downstream tasks. This approach significantly reduces energy consumption and improves inference speed using specialized kernels for efficient matrix multiplication.

huggingface.co · 24 min

TLDR AI

HOW WE SAVED HUNDREDS OF ENGINEERING HOURS BY WRITING TESTS WITH LLMS

Assembled uses LLMs to accelerate and improve software testing, enabling test generation in minutes instead of hours. This approach increases engineering productivity, saving time and shifting focus to feature development. LLMs generate comprehensive and accurate tests that maintain code quality and development velocity.

assembled.com · 7 min

TLDR AI

25% OF SMARTPHONE OWNERS DON'T WANT AI AS APPLE INTELLIGENCE DEBUTS

A CNET survey revealed that only 18% of smartphone users are motivated by AI features to upgrade their devices, with privacy and cost being significant concerns. Major manufacturers like Apple, Google, and Samsung are integrating more AI capabilities in their phones, yet many users prioritize battery life and storage over AI functions. AI subscriptions are set to become common, but nearly half of users are unwilling to pay for these features.

cnet.com · 6 min

TLDR AI

GOOGLE PREPS ‘JARVIS' AI AGENT THAT WORKS IN CHROME

Google's Project Jarvis, powered by Gemini 2.0, aims to automate web-based tasks in Chrome by using AI agents capable of reasoning and planning.

9to5google.com · 2 min

TLDR AI

OPENAI'S WHISPER TRANSCRIPTION TOOL HAS HALLUCINATION ISSUES, RESEARCHERS SAY

Concerns have risen over OpenAI's Whisper introducing hallucinations in transcriptions, even in medical contexts.

techcrunch.com · 1 min

TLDR AI

FORERUNNER K2 HUMANOID ROBOT CAN CARRY 33 LB IN EACH DEXTEROUS HAND

Kepler has unveiled the Forerunner K2 humanoid robot, which has advanced AI, improved hardware, and enhanced vision and navigation systems for better real-time interaction.

newatlas.com · 3 min