TLDR AI 2024-03-04

👉 Start Now 👉

ELON MUSK SUES OPENAI

Elon Musk, co-founder of OpenAI, is suing the company claiming - among other things - that GPT-4 constitutes AGI and is no longer subject to the Microsoft agreement. He also argues for more transparency and openness.

OPENAI WANTS TO MAKE A WALKING, TALKING HUMANOID ROBOT SMARTER

Humanoid robots could be working alongside human manufacturing workers in only a few short years. Figure, a prominent company in the humanoid robot space, recently raised $675 million and struck a new agreement with OpenAI to develop next-generation AI models for its robots. The funding, which was reportedly over $150 million more than the amount Figure had initially sought, will help scale up the company's AI training, robotic manufacturing, and add on new engineers, speeding up the company's timeline for making its product available commercially. OpenAI's technology will help improve Figure's robots' semantic understanding, making them more useful in work scenarios.

HYPERATTENTION: USED IN GEMINI

It is widely believed, and unofficially confirmed, that Gemini’s amazing 1m+ token context window uses HyperAttention to achieve such success.

WHY DO LEARNING RATES TRANSFER?

A theoretical paper that attempts to explain the success of MuP hyperparameter transfer. Its authors find that the largest eigenvalue of the training loss Hessian is independent of the width and depth of the network.

GPT-4 ONLY SUCCEEDS ON 14% OF AGENT TASKS

The community is very excited about the potential of Agents to tackle a variety of digital workloads. However, even the best general-purpose models struggle to complete tasks where humans succeed 70%+ of the time. It is becoming clear that we may need specially trained models for these tasks.

FINETUNE GEMMA 2.4X FASTER WITH UNSOLTH

Unsloth is a project that aims to rewrite important kernels for training and inferencing language models. It has released an example with code for Google’s open-source Gemma model.

3D GEOMETRIC VISION MADE EASY

This project supports constructing 3D representations, in GLB form, from a loosely related collection of images, meaning you can take a few pictures of a location and reconstruct it for 3D uses.

ENHANCING LATENT SPACE SMOOTHNESS IN TEXT-TO-IMAGE DIFFUSION MODELS

A new approach named Smooth Diffusion addresses the challenge of latent space smoothness in text-to-image diffusion models. This method ensures a consistent and gradual change in images in response to minor adjustments in input.

SURFACE NORMAL ESTIMATION

DSNIE is a method that dramatically improves monocular surface normal estimation which can be used in a number of computer graphics applications.

VISUAL PLACE RECOGNITION

CricaVPR introduces a novel approach for improving visual place recognition by focusing on the relationships between multiple images, even under different conditions.

MAGICLAB'S HUMANOID CAN TOAST MARSHMALLOWS, FOLD CLOTHES, AND DANCE

MagicLab has unveiled MagicBot, a humanoid robot that can roast marshmallows and dance. The robot has exceptional balance and dexterity - it has the capability to execute somersaults. MagicBot has sub-millimeter positioning accuracy and a load capacity reaching several kilograms. Videos of the robot in action are available in the article.

EMISSARY SIMPLE BENCHMARKING INFRASTRUCTURE (PRODUCT)

Emissary is releasing a benchmarking platform that enables developers to evaluate prompts and manage model migration and regression on their own terms rapidly and reliably. Generate and expand test sets, define custom metrics, and collaboratively rate outputs manually teams through automated LLM-assisted eval or outsource rating to Emissary.

COHERE OPENS NEW YORK OFFICE

Cohere, a language modeling company known for its strong embeddings, has opened a New York City office to improve collaboration with senior leadership at large companies.

AMAZON TO SPEND $1 BILLION ON STARTUPS THAT COMBINES AI WITH ROBOTS

Amazon's $1 billion industrial innovation fund is set to increase investments in companies that integrate artificial intelligence and robotics, aiming to enhance efficiency across its logistics network.