The Daily Index — Tuesday, September 3, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

FIRST MLPERF BENCHMARKS FOR NVIDIA BLACKWELL, AMD, GOOGLE, UNTETHER AI

Nvidia's new Blackwell chip demonstrated top per GPU performance in MLPerf's LLM Q&A benchmark, showcasing significant advancements with its 4-bit floating-point precision. However, competitors like Untether AI and AMD also showed promising results, particularly in energy efficiency. Untether AI's speedAI240 chip, for instance, excelled in the edge-closed category, highlighting diverse strengths across new AI inference hardware.

spectrum.ieee.org · 7 min

TLDR AI

DIFFUSION MODELS PERFORM SPECTRAL AUTO REGRESSION

Diffusion models and auto regressive models are often thought to be fundamentally different forms of methods. However, they may actually be more similar than we thought where diffusion models are actually taking auto regressive steps in the frequency domain.

sander.ai · 27 min

TLDR AI

ENHANCED ALZHEIMER'S DIAGNOSIS

This study presents a multimodal classification model designed to improve the early diagnosis of Alzheimer's Disease.

arxiv.org · 3 min

TLDR AI

CAUSAL INFERENCE IN COMPLEX SYSTEMS

Researchers have developed an advanced machine learning method for identifying both direct and indirect causal variables of a target within a system.

arxiv.org · 18 min

TLDR AI

IMPROVING AUDIO GENERATION WITH SEMANTIC AWARENESS

X-Codec is a new approach to enhancing the performance of audio generation by LLMs.

arxiv.org · 12 min

TLDR AI

CAN AI SCALING CONTINUE THROUGH 2030?

AI training is growing at an unprecedented 4x per year, outpacing mobile adoption and genome sequencing rates from past technological expansions. Research indicates scaling AI training could feasibly continue until 2030, constrained primarily by power availability and chip manufacturing capacity. Training runs up to 2e29 FLOP may become possible, marking substantial progress akin to the leap from GPT-2 to GPT-4, provided hundreds of billions are invested. Data scarcity and latency also pose challenges, but these may be surmountable through multimodal and synthetic data generation strategies and advanced network topologies.

epochai.org · 62 min

TLDR AI

MEET BOARDWALK ROBOTICS' ADDITION TO HUMANOID ROBOTS

Boardwalk Robotics has unveiled Alex, a humanoid upper torso robot designed for tasks in manufacturing, logistics, and maintenance. Developed independently while leveraging the pedigree of IHMC's bipedal robot expertise, Alex is legless, with its creators emphasizing manipulation over mobility to ensure safety and efficiency. Commercial partners are currently being selected for pilots, while researchers can purchase Alex immediately.

spectrum.ieee.org · 4 min

TLDR AI

GPU UTILIZATION IS A MISLEADING METRIC

While commonly monitored, GPU utilization may not accurately reflect true GPU performance in ML workloads, as it doesn't account for whether the GPU's computational power is fully leveraged. Trainy discovered this while only achieving ~20% model FLOPS utilization (MFU) despite 100% GPU utilization during LLM training. It recommends tracking SM efficiency for a better performance indicator and achieving a 4x speedup in training time by optimizing with fused kernels and the right model parallelism level.

trainy.ai · 6 min

TLDR AI

AI-IMPLANTED FALSE MEMORIES

A study from MIT Media Lab found that generative chatbots powered by large language models significantly increased the formation of false memories during simulated crime witness interviews, inducing over three times more immediate false memories than a control group.

media.mit.edu · 3 min

TLDR AI

VISION MODEL LEADERBOARD (HUGGING FACE HUB)

Timm is a package of vision models.

huggingface.co

TLDR AI

COGVIDEO 5B LAUNCHING NEXT WEEK

CogVideo 5B model will launch next week in Hugging Face Diffusers.

github.com · 2 min