TLDR AI 2024-02-06

QWEN 1.5 MODELS RELEASED

From 0.5B to 72B parameters. These are an impressive suite of multilingual models. Interestingly, the smallest model is the first serious sub 1B parameter language model.

INSIDE OPENAI’S PLAN TO MAKE AI MORE ‘DEMOCRATIC’

In May 2023, Colin Megill met with OpenAI, including co-founder Wojciech Zaremba, to discuss integrating his public deliberation platform, Polis, which used AI to enhance democratic engagement. The collaboration aimed to align AI with human values through broad public input. It sparked OpenAI's "Democratic Inputs to AI" initiative to explore AI governance with a $1 million grant program.

BOXIMATOR: CONTROLLABLE VIDEO SYNTHESIS

Video synthesis is notoriously hard to control. This work proposes using boxes and arrows to guide the generation over time, which improves human preference judgment but still doesn’t give perfect guidance to the user.

A NEW OPTIMIZATION METHOD FOR ALIGNING AI

Kahneman-Tversky Optimization (KTO) is a new approach for training AI models to align better with human thinking. By utilizing concepts from Kahneman & Tversky's prospect theory, KTO focuses on maximizing utility rather than just preference likelihood.

MULTIMODAL HALLUCINATIONS IN AI

This paper sheds light on why large vision-language models (LVLMs) sometimes incorrectly describe images, a phenomenon known as multimodal hallucination. Semantic shift bias, particularly around paragraph breaks, is a key factor.

3-day money-back guarantee* Join 1 million travelers

OPEN SOURCE ALTERNATIVE TO RABBIT

A group is working to build an open-source version of the Rabbit hardware including the language modeling portion.

NATURALSQL

NaturalSQL by ChatDB is a series of models with state-of-the-art performance on Text-to-SQL instructions.

GENERATING DIVERSE HUMAN PORTRAITS FROM A SINGLE PHOTO

CapHuman is a framework that can create various images of a person using just one reference photo. It cleverly maintains the person's identity while changing head positions and expressions.

PEARLS CONTEXTUAL BANDIT TUTORIAL

Pearls is an RL framework maintained by Meta. This tutorial walks through a bandit-based learning problem with the software.

AI’S LABOR MARKET IMPACTS ARE SLOWER THAN EXPECTED

The working paper "Beyond AI Exposure: Which Tasks are Cost-Effective to Automate with Computer Vision?" by researchers from MIT and IBM examines the economic viability of automating vision-based tasks. It found only 23% are cost-effective for automation. The paper predicts a gradual labor market impact over years, contrasting with more disruptive forecasts.

A NEW BENCHMARK IN TEXT EMBEDDING MODELS

Nomic-Embed-Text-V1 sets a new standard as an open-source, fully reproducible text embedding model. It excels in both short and long-context tasks. Unique in its transparency, Nomic-Embed-Text-V1 offers complete access to its training code, model weights, and a vast dataset of 235 million text pairs.

MATRICES (PRODUCT LAUNCH)

Matrices is an AI-native spreadsheet that creates itself and fills itself with whatever information you need. It can be extended with just natural language.

HOW AI IS HELPING US LEARN ABOUT BIRDS

BirdCast, a collaboration between the Cornell Lab of Ornithology, Colorado State University, and UMass Amherst, uses machine learning and radar data to predict bird migrations. The project demonstrates AI's potential to revolutionize ornithology by enhancing understanding of ecosystem health and migration patterns.

ROBLOX RELEASES REAL-TIME AI CHAT TRANSLATOR

Roblox has developed an AI model capable of translating text chats in real-time across 16 languages to enhance user engagement by breaking down language barriers. It utilizes a transformer-based large language model within a Mixture-of-Experts architecture for efficient resource use while maintaining their privacy and safety processes.

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930