TLDR Index
TLDR AI

TLDR AI 2025-01-30

6 sections20 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

DARIO AMONDEI ON DEEPSEEK AND EXPORT CONTROLS

Anthropic's CEO gives great insight into the DeepSeek models, cost curves, and innovation. He expertly lays out the landscape and points to flaws in the market reaction. Additionally, he reveals that Sonnet 3.5 only cost $10m or so dollars to train. The main point of the article is export controls.

darioamodei.com15 min read

OPENAI ACCUSES DEEPSEEK

OpenAI has found evidence that the Chinese AI startup DeepSeek used its proprietary models to train an open-source competitor. The suspected "distillation" process allows smaller models to mimic larger ones at a lower cost, raising concerns over intellectual property breaches.

ft.com4 min read

03RESEARCH & INNOVATION

QWEN 2.5 MAX MOE MODEL

The Qwen team has released its MoE earlier than expected. The model shows really strong performance, matching many top models, including DeepSeek v3.

qwenlm.github.io12 min read

OPTIMIZING LARGE LANGUAGE MODEL TRAINING USING FP4 QUANTIZATION

One of the key levers that can be pulled to reduce training and inference costs is quantization. Getting these models to run at lower precision saves on the number of GPUs and FLOPs needed for training. This work shows, on a small scale of 100B tokens, how to train at FP4.

arxiv.org30 min read

TEXT-TO-VIDEO GENERATION WITH CASCADEV

CascadeV introduces a cascaded latent diffusion model that generates 2K-resolution videos with improved efficiency. It employs a novel 3D attention mechanism and can be integrated with existing text-to-video models to enhance resolution and frame rate without fine-tuning.

arxiv.org12 min read

04ENGINEERING & RESOURCES

Sponsored

YOU.COM: 20+ MODELS, 1 CHAT INTERFACE

With new models popping up every day, you want to stay flexible. You.com [13] gives you the freedom to switch between models on the fly, including the latest models from OpenAI, DeepSeek, and Anthropic.

you.comSponsor

EFFICIENT COMPRESSION FOR SSM-BASED MODELS

Mamba-Shedder is a method that optimizes structured state space models by selectively removing redundant components. The approach improves inference speed by up to 1.4x while maintaining model accuracy.

arxiv.org19 min read

AI FOR VALUE MEASUREMENT AND SAFETY

This project introduces Generative Psychometrics for Values, a novel method that uses large language models to measure human and AI values.

github.comGitHub repository

LLMS WITH SPECIALIZED TOOLS

TART enhances large language models by integrating them with computational tools, improving accuracy and transparency in tasks like finance, science, and healthcare.

github.comGitHub repository

05MISCELLANEOUS

WRITERS VS. AI: MICROSOFT STUDY REVEALS HOW GPT-4 IMPACTS CREATIVITY AND VOICE

Microsoft and USC conducted a study using GPT-4 to explore how generative AI affects writers' authenticity and creativity. Writers expressed concerns about AI impacting originality, emotional satisfaction, and ownership of work. Despite initial skepticism, personalized AI models that align with a writer's style helped alleviate these concerns, enhancing creativity without compromising authenticity.

techtimes.com3 min read

WE INTERVIEW THE FOUNDER BEHIND MEGAN, AN AI HR AGENT

Interview Mega HR has launched "Megan", an AI agent designed to streamline and automate recruitment processes. Megan handles tasks from job posting to candidate management, aiming to improve hiring efficiency and transparency.

theregister.com14 min read

DEEPSEEK'S R1 RECIPE

Nathan Lambert breaks down the recipe for R1 and talks through what it means for us now and for the field broadly. Specifically, he focuses on the interesting application of reinforcement learning.

interconnects.ai27 min read