TLDR AI 2023-10-04

REKA LAUNCHES THEIR FLAGSHIP MULTIMODAL MODELS

Yasa-1 is an audio, video, and text model from the creators of the extremely popular T5 language model. It boasts impressive performance across a number of tasks. Yasa-1 is currently in private preview.

LINKEDIN GOES BIG ON NEW AI TOOLS

LinkedIn is launching a series of AI-based features to enhance its job hunting, marketing, and sales offerings. These include an improved version of its Recruiter talent sourcing platform with integrated AI, an AI-driven LinkedIn Learning coach, and a new AI tool for marketing campaigns.

Despite open-source AI democratization, over 60% of generative AI job postings from July 2022-2023 were in 10 major tech hubs. Interventions and expanded research programs are needed to diversify AI's geographic footprint.

GENERALIST ROBOT POLICY

A robot's policy is the guiding algorithm that determines how it acts. Typically these are robot and task specific. This makes it hard for robotics to adapt. This new work from Google shows a single (55B parameter) policy that can perform 160k+ different tasks.

MAKING MULTI-MODAL LLMS WORK FOR DIFFERENT TASKS

Multi-modal Large Language Models excel in many tasks but often struggle to pinpoint specific objects in images. Researchers have developed a way to improve this by turning object locations into text and training the model with special tasks.

EFFICIENT LARGE-SCALE 3D SCENE RECONSTRUCTION

Rebuilding large 3D scenes, especially when some data is missing, is crucial for self-driving cars. This new method, PC-NeRF, combines two modules to optimize the reconstruction at multiple levels, ensuring detailed 3D models even with incomplete data.

BETTER IMAGE RESTORATION WITH VISION-LANGUAGE MODELS

Vision-language models like CLIP work well for many tasks but struggle with image restoration. This project introduces DA-CLIP, a model that adjusts how CLIP works to handle these tasks better, leading to clearer image reconstructions.

ONNXSTREAM

A program that enables you to run Stable Diffusion 1.5 on a Raspberry Pi Zero 2.

LARGE WORLD MODELS FOR SELF DRIVING

Most self driving systems have been large combinations of rules-based, expert systems, and learned modules. This work by Wayve shows a 9B joint video, action, and text model that performs extremely well in diverse scenarios.

IS DATA STILL A MOAT?

Generative AI is reshaping the traditional value placed on vast data collections. As large language models can be fine-tuned with minimal data and even generate synthetic datasets, the uniqueness and importance of proprietary data may be waning.

AI IS GETTING BETTER AT HURRICANE FORECASTING

Hurricane Lee's path was predicted by AI-based models from Nvidia, Huawei, and DeepMind. These AI models, which analyze patterns from historical atmospheric data, have shown comparable or sometimes better performance in storm tracking than conventional models, delivering rapid results in minutes instead of hours, and might play a significant role in official forecasts in the coming years.

THE NATIONAL SECURITY AGENCY IS STARTING AN AI SECURITY CENTER

The National Security Agency is starting an artificial intelligence security center in order to keep pace with the rapid integration of AI into U.S. defense and intelligence systems.