The Daily Index — Monday, March 4, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

OPENAI WANTS TO MAKE A WALKING, TALKING HUMANOID ROBOT SMARTER

Humanoid robots could be working alongside human manufacturing workers in only a few short years. Figure, a prominent company in the humanoid robot space, recently raised $675 million and struck a new agreement with OpenAI to develop next-generation AI models for its robots. The funding, which was reportedly over $150 million more than the amount Figure had initially sought, will help scale up the company's AI training, robotic manufacturing, and add on new engineers, speeding up the company's timeline for making its product available commercially. OpenAI's technology will help improve Figure's robots' semantic understanding, making them more useful in work scenarios.

popsci.com · 9 min

TLDR AI

HYPERATTENTION: USED IN GEMINI

It is widely believed, and unofficially confirmed, that Gemini’s amazing 1m+ token context window uses HyperAttention to achieve such success.

arxiv.org · 18 min

TLDR AI

WHY DO LEARNING RATES TRANSFER?

A theoretical paper that attempts to explain the success of MuP hyperparameter transfer. Its authors find that the largest eigenvalue of the training loss Hessian is independent of the width and depth of the network.

arxiv.org · 26 min

TLDR AI

GPT-4 ONLY SUCCEEDS ON 14% OF AGENT TASKS

The community is very excited about the potential of Agents to tackle a variety of digital workloads. However, even the best general-purpose models struggle to complete tasks where humans succeed 70%+ of the time. It is becoming clear that we may need specially trained models for these tasks.

arxiv.org · 25 min

TLDR AI

FINETUNE GEMMA 2.4X FASTER WITH UNSOLTH

Unsloth is a project that aims to rewrite important kernels for training and inferencing language models. It has released an example with code for Google’s open-source Gemma model.

unsloth.ai · 8 min

TLDR AI

ENHANCING LATENT SPACE SMOOTHNESS IN TEXT-TO-IMAGE DIFFUSION MODELS

A new approach named Smooth Diffusion addresses the challenge of latent space smoothness in text-to-image diffusion models. This method ensures a consistent and gradual change in images in response to minor adjustments in input.

shi-labs.github.io · 4 min

TLDR AI

SURFACE NORMAL ESTIMATION

DSNIE is a method that dramatically improves monocular surface normal estimation which can be used in a number of computer graphics applications.

baegwangbin.github.io · 4 min

TLDR AI

VISUAL PLACE RECOGNITION

CricaVPR introduces a novel approach for improving visual place recognition by focusing on the relationships between multiple images, even under different conditions.

arxiv.org · 14 min

TLDR AI

MAGICLAB'S HUMANOID CAN TOAST MARSHMALLOWS, FOLD CLOTHES, AND DANCE

MagicLab has unveiled MagicBot, a humanoid robot that can roast marshmallows and dance. The robot has exceptional balance and dexterity - it has the capability to execute somersaults. MagicBot has sub-millimeter positioning accuracy and a load capacity reaching several kilograms. Videos of the robot in action are available in the article.

interestingengineering.com · 6 min

TLDR AI

EMISSARY SIMPLE BENCHMARKING INFRASTRUCTURE (PRODUCT)

Emissary is releasing a benchmarking platform that enables developers to evaluate prompts and manage model migration and regression on their own terms rapidly and reliably. Generate and expand test sets, define custom metrics, and collaboratively rate outputs manually teams through automated LLM-assisted eval or outsource rating to Emissary.

withemissary.com

TLDR AI

COHERE OPENS NEW YORK OFFICE

Cohere, a language modeling company known for its strong embeddings, has opened a New York City office to improve collaboration with senior leadership at large companies.

txt.cohere.com · 2 min

TLDR AI

AMAZON TO SPEND $1 BILLION ON STARTUPS THAT COMBINES AI WITH ROBOTS

Amazon's $1 billion industrial innovation fund is set to increase investments in companies that integrate artificial intelligence and robotics, aiming to enhance efficiency across its logistics network.

arstechnica.com · 2 min