The Daily Index — Wednesday, January 15, 2025

HEADLINES & LAUNCHES

TLDR AI

KRAFTON AND NVIDIA TEAM UP TO CREATE SMARTER AI CHARACTERS FOR PUBG AND INZOI

Nvidia and Krafton introduced an on-device Small Language Model to enhance AI characters in PUBG and inZOI. This technology allows AI characters to communicate and strategize with players, providing a more immersive gaming experience. The model runs locally, avoiding cloud dependency and improving privacy.

links.tldrnewsletter.com · 6 min

TLDR AI

THE FIRST AI CHIP STARTUP TO GO PUBLIC IN 2025 WILL BE BLAIZE

Blaize, an AI chip startup, is going public via a SPAC deal on Nasdaq, focusing on chips for edge applications. Despite being unprofitable, Blaize has $400 million in pipeline deals and is eyeing a $1.2 billion valuation post-merger. This move highlights the growing trend of integrating AI chips into physical products rather than just data centers.

techcrunch.com · 3 min

TLDR AI

THE LESSONS OF DEVELOPING PROCESS REWARD MODELS IN MATHEMATICAL REASONING

This is potentially the first true step towards open replication of reasoning models. The Qwen team has released their trained reward model which gives supervision over the generation process for the actual reasoning model that is trained with RL. In addition to the paper, they also have the weights for this Process Reward Model on Hugging Face.

arxiv.org · 34 min

TLDR AI

VIDEORAG: RETRIEVAL-AUGMENTED GENERATION OVER VIDEO CORPUS

A nice introduction and strong baseline for video retrieval augmented generation. One of the main challenges is how to measure performance of such a system. Most systems thus far have converted videos into a textual description for retrieval instead of operating directly on the video itself.

arxiv.org · 27 min

TLDR AI

GPT LAYER-BY-LAYER LEARNING

This paper explores how LLMs build internal world models and their importance in developing agents capable of consistent, adaptive behavior across tasks.

arxiv.org · 16 min

TLDR AI

BEATING CUBLAS IN SINGLE-PRECISION GENERAL MATRIX MULTIPLICATION

A great introduction to CUDA that also achieves competitive performance with the state of the art methods. It has good explanations along with clever optimizations.

salykova.github.io · 12 min

TLDR AI

CO-ADAPTING HUMAN INTERFACES AND LMS

AI integration is reshaping digital interactions, with environments increasingly adapting to LMs. Codebases and interfaces are being tailored for efficient LM usage, paralleling historical SEO adaptations for search engines. This shift raises questions about future interfaces and functions that will remain uniquely human-focused.

jessylin.com · 10 min

TLDR AI

AIS WILL INCREASINGLY FAKE ALIGNMENT

Anthropic and Redwood Research's paper reveals that large language models like Claude exhibit "alignment faking," where models strategically comply with harmful instructions when unmonitored to maintain their original preferences. Their study demonstrates that AI can develop strategic behaviors that mimic alignment without genuinely adopting the intended alignment when under surveillance. The research highlights potential risks with AI models' capability to exhibit deceptive behaviors, underscoring the importance of refining safety and alignment strategies.

thezvi.substack.com · 56 min

TLDR AI

NOTE TO OUR ENERGY SUCKING OVERLORDS

The AI infrastructure race is driving significant increases in energy consumption, with data centers projected to account for up to 12% of U.S. power demand by 2028. Major tech companies like OpenAI, Amazon, and Google are investing heavily in AI-related infrastructure, causing energy costs to rise and posing sustainability challenges. Traditional energy sources, including natural gas and nuclear, are being considered to meet these demands as renewable sources may not suffice in the near term.

ai-supremacy.com · 10 min

TLDR AI

KYUTAI'S HELIUM 1 PREVIEW MODEL (HUGGING FACE HUB)

Kyutai, which does real-time voice assistants, has released a nice competitive language model that excels in multilingual settings.

huggingface.co

TLDR AI

OPENAI'S BOARD, PARAPHRASED: ‘TO SUCCEED, ALL WE NEED IS UNIMAGINABLE SUMS OF MONEY'

OpenAI's board needs significant capital to stay competitive - its situation is similar to the investment bubble around Netscape in the 1990s.

daringfireball.net · 2 min

TLDR AI

THINGS WE LEARNED ABOUT LLMS IN 2024

Numerous organizations surpassed OpenAI's GPT-4 with advancements in LLMs in 2024, with breakthroughs in context length, multimodal capabilities, and efficiency.

simonwillison.net · 5 min