The Daily Index — Friday, June 7, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

NVIDIA EMAILS: ELON MUSK DIVERTING TESLA GPUS TO HIS OTHER COMPANIES

Elon Musk redirected 12,000 H100 GPUs ordered by Tesla to X. He had told investors in April that Tesla had spent $1 billion on GPUs in the three months of the year. Tesla has been developing its own in-house supercomputer for AI, but Musk has previously said that it would be redundant if the company could source more H100s. X's order of 12,000 H100s will be redirected to Tesla.

arstechnica.com · 3 min

TLDR AI

SECURING RESEARCH INFRASTRUCTURE FOR ADVANCED AI

OpenAI has outlined the security architecture of its AI training supercomputers, emphasizing the protection of sensitive model weights and other assets using Azure-based infrastructure and Kubernetes for orchestration.

links.tldrnewsletter.com · 5 min

TLDR AI

EXTRACTING CONCEPTS FROM GPT-4

The team at OpenAI has discovered 16 million interpretable features in GPT-4 including price increases, algebraic rings, and who/what correspondence. This is a great step forward for SAE interpretability at scale. They shared the code in a companion GitHub repository.

links.tldrnewsletter.com · 8 min

TLDR AI

DRAGONFLY VISION MODEL

The Together AI team has a novel VLM that excels at extremely high resolution images due to its efficient architecture.

together.ai · 11 min

TLDR AI

SELF-ATTENTION WITH CONVOLUTIONS

Researchers have developed a novel approach called FFNification that transforms self-attention mechanisms into more efficient token mixers using only convolutions while keeping the query-key-value framework.

arxiv.org · 16 min

TLDR AI

MESOP: GRADIO COMPETITION

Google has released a competitor to Gradio, a popular AI prototyping framework. Mesop is pure Python and has slightly more composability but is less mature than Gradio.

google.github.io · 3 min

TLDR AI

VISUAL GEO-LOCALIZATION WITH MULTI-MODAL LEARNING

Researchers have developed a new two-stage training method to improve Visual Geo-localization (VG), enhancing its performance in applications like autonomous driving, augmented reality, and SLAM.

arxiv.org · 24 min

TLDR AI

A GRAND UNIFIED THEORY OF THE AI HYPE CYCLE

The AI industry has seen several hype cycles throughout the decades, each producing genuinely useful technology and lasting longer than the last. Every cycle follows the process of a sigmoid curve rather than an exponential one. All strategies for developing the technology inevitably have a limit that doesn't take too long to find. While the current AI hype cycle is unlike any that have come before it, it will likely follow a similar trajectory as previous cycles.

blog.glyph.im · 8 min

TLDR AI

AI VOICE AGENTS

Andreessen Horowitz put together a blog post and deck outlining the state of play for AI voice agents and where it sees opportunities for innovation and investment. It covers the currently leading infrastructure stack and maps out the current B2B and B2C application layer landscape.

a16z.com · 10 min

TLDR AI

ADVANCING IMPLICIT NEURAL REPRESENTATIONS WITH RELU

Researchers have revisited the use of ReLU activation functions in learning implicit neural representations (INRs). Inspired by second-order B-spline wavelets, they introduced simple constraints to ReLU neurons to counter spectral bias.

arxiv.org · 26 min

TLDR AI

SYNTHFLOW AI (PRODUCT)

Automate customer interactions with AI voice assistants.

synthflow.ai

TLDR AI

MMLU PRO (HUGGING FACE HUB)

MMLU is the standard measure of reasoning and knowledge for language models.

huggingface.co

TLDR AI

NVIDIA IS NOW MORE VALUABLE THAN APPLE AT $3.01 TRILLION

Nvidia became the second most valuable company in the world on Wednesday afternoon as its market capitalization hit $3.01 trillion.

theverge.com · 1 min