TLDR AI 2024-06-07

>> Use code TLDR60 today for an exclusive 60% discount

QWEN 2 LAUNCH

Qwen 2 is a new flagship language model from Alibaba Cloud. It slightly surpasses Llama 3 70B on benchmark performance in English while being a better multilingual model.

NVIDIA EMAILS: ELON MUSK DIVERTING TESLA GPUS TO HIS OTHER COMPANIES

Elon Musk redirected 12,000 H100 GPUs ordered by Tesla to X. He had told investors in April that Tesla had spent $1 billion on GPUs in the three months of the year. Tesla has been developing its own in-house supercomputer for AI, but Musk has previously said that it would be redundant if the company could source more H100s. X's order of 12,000 H100s will be redirected to Tesla.

SECURING RESEARCH INFRASTRUCTURE FOR ADVANCED AI

OpenAI has outlined the security architecture of its AI training supercomputers, emphasizing the protection of sensitive model weights and other assets using Azure-based infrastructure and Kubernetes for orchestration.

EXTRACTING CONCEPTS FROM GPT-4

The team at OpenAI has discovered 16 million interpretable features in GPT-4 including price increases, algebraic rings, and who/what correspondence. This is a great step forward for SAE interpretability at scale. They shared the code in a companion GitHub repository.

DRAGONFLY VISION MODEL

The Together AI team has a novel VLM that excels at extremely high resolution images due to its efficient architecture.

SELF-ATTENTION WITH CONVOLUTIONS

Researchers have developed a novel approach called FFNification that transforms self-attention mechanisms into more efficient token mixers using only convolutions while keeping the query-key-value framework.

checkout for 50% off

MESOP: GRADIO COMPETITION

Google has released a competitor to Gradio, a popular AI prototyping framework. Mesop is pure Python and has slightly more composability but is less mature than Gradio.

ENHANCING LONG-RANGE DEPENDENCIES IN STATE SPACE MODELS

GrootVL is a network that improves state space models by dynamically generating a tree topology based on spatial relationships and input features.

VISUAL GEO-LOCALIZATION WITH MULTI-MODAL LEARNING

Researchers have developed a new two-stage training method to improve Visual Geo-localization (VG), enhancing its performance in applications like autonomous driving, augmented reality, and SLAM.

A GRAND UNIFIED THEORY OF THE AI HYPE CYCLE

The AI industry has seen several hype cycles throughout the decades, each producing genuinely useful technology and lasting longer than the last. Every cycle follows the process of a sigmoid curve rather than an exponential one. All strategies for developing the technology inevitably have a limit that doesn't take too long to find. While the current AI hype cycle is unlike any that have come before it, it will likely follow a similar trajectory as previous cycles.

AI VOICE AGENTS

Andreessen Horowitz put together a blog post and deck outlining the state of play for AI voice agents and where it sees opportunities for innovation and investment. It covers the currently leading infrastructure stack and maps out the current B2B and B2C application layer landscape.

ADVANCING IMPLICIT NEURAL REPRESENTATIONS WITH RELU

Researchers have revisited the use of ReLU activation functions in learning implicit neural representations (INRs). Inspired by second-order B-spline wavelets, they introduced simple constraints to ReLU neurons to counter spectral bias.

SYNTHFLOW AI (PRODUCT)

Automate customer interactions with AI voice assistants.

MMLU PRO (HUGGING FACE HUB)

MMLU is the standard measure of reasoning and knowledge for language models.

NVIDIA IS NOW MORE VALUABLE THAN APPLE AT $3.01 TRILLION

Nvidia became the second most valuable company in the world on Wednesday afternoon as its market capitalization hit $3.01 trillion.