TLDR AI 2024-05-31

Up your game with LMNT ↗️

PERPLEXITY PAGES

The Perplexity search engine has announced a new product for creating long-lasting research artifacts that are shareable and created with AI.

WONDER DYNAMICS ACQUIRED BY AUTODESK

The AI VFX company with Hollywood ties has been acquired by software maker Autodesk for an undisclosed amount.

ANTHROPIC'S AI NOW LETS YOU CREATE BOTS TO WORK FOR YOU

Anthropic is introducing a "tool use" feature for its Claude AI chatbot, enabling users to create personalized assistants that can interact with any external API. This feature can analyze data, provide product recommendations, track orders, offer technical support, and even process images for applications like interior design.

YUAN 2.0-M32: MIXTURE OF EXPERTS WITH ATTENTION ROUTER

Yuan 2.0-M32 is a Mixture of Experts model with 40B parameters, 3.7B active at any time. It performs close to Llama 3 70B despite using 1/19th the compute. It was trained on 2T tokens and seems surprisingly powerful for its size.

SCALING LAWS AND COMPUTE-OPTIMAL TRAINING BEYOND FIXED TRAINING DURATIONS

The original scaling laws papers used a Cosine learning rate schedule which doesn't achieve optimal loss if the Cosine period isn't aligned with the total training steps. This makes it challenging to train enough models to create meaningful scaling laws. This paper introduces the idea of a constant learning rate with a cool down as a way to reduce GPU costs for scaling law creation.

ULTRA-HD IMAGE DERAINING

Researchers have introduced a new dataset called 4K-Rain13k that features 13,000 pairs of 4K resolution images to tackle the challenge of deraining ultra-high-definition (UHD) images.

SDXL SCRIBBLE CONTROLNET

Scribble ControlNet allows you to draw arbitrary lines as conditioning information for image generation. It was trained on substantially more post training images than other ControlNets and boasts powerful performance.

VIDEO GENERATION WITH TRANSFORMERS

EasyAnimate is a method that adapts the DiT framework for advanced 3D video generation using transformers. This project incorporates a motion module block to capture temporal dynamics, ensuring smooth motion transitions and consistent frames.

BOOSTING LANGUAGE MODELS WITH SELF-EXPLORING OPTIMIZATION

Self-Exploring Language Models (SELM) is a method that enhances preference optimization in LLMs using online feedback.

TEXT2VIDEO TURBO

Consistency Distillation applied to video models dramatically reduces the number of steps needed to generate content.

AI WON'T EAT YOUR JOB, BUT IT WILL EAT YOUR SALARY

AI threatens not just the existence of jobs but the skill premium associated with tasks, potentially reducing the wages for skilled labor. AI could re-bundle job tasks and lower the barriers to task performance, leading to commoditization and decreased ability to charge a premium salary. As AI evolves, especially through AI agents, managerial advantages may also diminish, challenging the human-in-the-loop advantage and further eroding skill premiums.

PATRONUS AI RAISES $17M SERIES A

Patronus builds automated security for language models.

NEURALINK RIVAL SETS BRAIN-CHIP RECORD WITH 4,096 ELECTRODES ON HUMAN BRAIN

Precision Neuroscience claims to have set a new record for the number of neuron-tapping electrodes placed on a living human's brain at 4,096.

GOOGLE ADDS AI-POWERED FEATURES TO CHROMEBOOK

Google announced new AI features for Chromebook Plus devices, including a writing assistant, wallpaper creator, and easy access to the Gemini chatbot.