TLDR AI

TLDR AI 2024-01-22

5 sections19 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

THE AI PHONES ARE COMING

Samsung is set to unveil new AI-focused phones, highlighting the evolution of AI in mobile technology, exemplified by Google's Pixel 8 Pro and the popular Rabbit R1 from CES 2024.

theverge.com2 min read

02RESEARCH & INNOVATION

DEEPDIVE: TEXT-TO-VIDEO

Generating video from text descriptions is an active area of research with many powerful models coming in the last few weeks. This blog from the Hugging Face team outlines the task, current challenges, and the state of the research. It isn’t completely comprehensive, but will give a great starting point for further reading.

huggingface.co18 min read

A MODEL FOR ALL KINDS OF IMAGE AND VIDEO SEGMENTATION

OMG-Seg is a new model that can perform various image and video segmentation tasks using a single efficient system. Unlike traditional methods that use different models for each task, OMG-Seg handles everything from image semantics to interactive video segmentation, making it a one-stop solution with reduced complexity and enhanced performance.

lxtgh.github.io2 min read

OPEN-VOCABULARY VIDEO INSTANCE SEGMENTATION

Researchers have developed BriVIS, a method that improves open-vocabulary Video Instance Segmentation (VIS). By using a technique called Brownian Bridges, BriVIS maintains the context of object movements across video frames, leading to a more accurate alignment between video and text.

arxiv.org14 min read

03ENGINEERING & RESOURCES

Sponsored

WIKICHAT: BUILD A REAL-TIME RAG APP ON WIKIPEDIA WITH LANGCHAIN.JS, VERCEL, AND ASTRA DB

🆕 DataStax has recently introduced its new Data API [12] — an easy way to develop GenAI and RAG apps on Astra DB. Want to see how it works? Check out this upcoming livestream to hear from engineers at DataStax and LangChain and dive into how they built WikiChat, a natural language interface to Wikipedia. Register for the livestream

crowdcast.ioSponsor

LIBRARY FOR 3D PARALLELISM

HuggingFace has released Nanotron, a small and powerful library for training models with 3D parallelism. This means it splits the data, the model, and the layers/tensors in the model. The first two types of parallelism are well supported in libraries like PyTorch. However, splitting the model tensors is custom to each model and hard to implement in general. This library provides useful primitives to make that process easier and less error-prone.

github.comGitHub repository

LIBRARY FOR DATA FILTERING

HuggingFace has released Datatrove, a library for filtering large text datasets. It has many useful primitives and full parallel pipelines for text filtering. Examples using Gopher quality filters in C4 are available.

github.comGitHub repository

IMAGE CAPTIONING SOFTWARE

Simple software that can be used to add captions to your images for AI training.

github.comGitHub repository

04MISCELLANEOUS

HOW MICROSOFT FOUND A POTENTIAL NEW BATTERY MATERIAL USING AI

Microsoft and the Pacific Northwest National Laboratory have found a new battery material using AI and large-scale cloud computing. The material is a new kind of solid-state electrolyte. It could lead to batteries that are less likely to burst into flames compared to lithium-ion batteries. While the material still needs to be tested to see whether it is a viable alternative to lithium-ion batteries, the finding demonstrates AI's potential for speeding up material discovery.

theverge.com4 min read

CLEARER REMOTE SENSING IMAGES

RSHazeNet is a new framework designed to remove haze from remote-sensing images. The tool uses innovative modules to better understand and preserve important details in images, making them clearer and more useful for analysis.

arxiv.org7 min read

BOOSTING VISION FOUNDATION MODELS

The new ViSFT method enhances vision foundation models, like those used in image-text training, by applying a two-stage process similar to fine-tuning in language models.

github.comGitHub repository