TLDR AI 2023-02-20

GITHUB COPILOT GETS AN UPGRADE

HOW SHOULD AI SYSTEMS BEHAVE, AND WHO SHOULD DECIDE?

1B MULTIMODAL MODEL OUT PERFORMS 175B COUNTERPART

Narrow models can still, unsurprisingly, beat larger general purpose models. This paper is another example, the authors use a small multimodal model to beat GPT3 by 16% on the visual / text benchmark ScienceQA. It's only one benchmark, but it's good to see improvements on more reasonably sized models.

THE STABLE ENTROPY HYPOTHESIS

This paper submits an hypothesis that “human-like” text generation lies in a narrow region of low entropy. Degenerate text which has repeated words, incoherent sentences, and grammatical errors lie away from this region. They provide supporting evidence and present an entropy aware decoding scheme.

MORAL SELF-CORRECTION IN LARGE LANGUAGE MODELS

Large language models (LLMs) exhibit harmful biases that can get worse with size. Reinforcement learning from human feedback (RLHF) helps, but not always enough. The authors show that simple prompting approaches can help LLMs trained with RLHF produce less harmful outputs.

NAVIGATING THE MANIFOLD OF LATENTS IN STABLE DIFFUSION

LANGCHAIN FOR THE WEB

Similar to other recently released libraries, Langchain now has a JavaScript library. Use this to build LM powered web apps. Importantly, interfacing with the python version is a huge focus specifically around serialization of objects.

TALK-TO-CHATGPT

Talk-To-ChatGPT is a Google Chrome extension that allows users to talk with ChatGPT using their voice and listen to the AI’s answer with a voice.

SCALING MEDIA ML AT NETFLIX

HOW TO FINE-TUNE THE MOST POWERFUL OPEN SOURCE LLM

THE PHYSICS PRINCIPLE THAT INSPIRED MODERN AI ART

SUMMARY OF CREATIVE AI RESEARCH AT SONY

A list of papers from the Sony creative AI research group. They focus on deep generative modeling, music, and cinematic AI. Lots of great links here to put on your reading list if you want to understand the state of the art for music.

AI CAN HELP DESIGN OPIOID DRUGS

AI BREAST CANCER DIAGNOSTICS

AI BECOMES SILICON VALLEY’S NEXT BUZZY BANDWAGON AS CRYPTO BOOM FIZZLES

Technologists agree that the generative AI that powers systems like ChatGPT has the potential to change how we live and work, despite the technology’s clear flaws. But some people see signs of froth that remind them of the crypto boom that recently fizzled.