The Daily Index — Thursday, September 7, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

FALCON 180B MODEL RELEASED

The Falcon models from the UAE have long been the best open models available. The newest 180B parameter model slightly outperforms Llama 2 70B and has a 2k context window. The models have historically been quite tunable. However, given the resource requirements, it's not clear whether the community will adopt this newest model.

falconllm.tii.ae · 6 min

TLDR AI

OPENAI’S FIRST DEVELOPER CONFERENCE

OpenAI will hold its inaugural DevDay conference in San Francisco on November 6, 2023. This event will preview new tools and foster idea exchange, attracting hundreds globally. Currently, over 2 million developers use tools like GPT-4 and DALL·E through OpenAI's continuously updated API.

openai.com · 2 min

TLDR AI

REDUCING PPO MEMORY USAGE IN RLHF

PPO is a pain in RLHF because you need to have 3 models floating around. However, they all stay close and only require small updates from one another. Enter LoRA. If you instead use adapters you can dramatically reduce memory costs without losing performance. Beautiful idea in its simplicity.

arxiv.org · 25 min

TLDR AI

SIMULATING AN ORDER BOOK IN JAX

Financial institutions use something called a limit order book to maintain all of the transaction information for trades on their platforms. This is useful, but it usually runs on the CPU, which makes running RL on them hard. This paper talks through creating an order book that runs on the GPU written in JAX.

arxiv.org · 28 min

TLDR AI

ENHANCING SPEECH-DRIVEN 3D FACE ANIMATION

This study delves into the complexities of 3D face animation driven by speech, highlighting two important aspects: global factors that change how the face moves over time (composite nature) and how different parts of the face move independently based on local muscles (regional nature).

arxiv.org · 14 min

TLDR AI

MAKING VIDEO AVATARS ADAPT TO DIFFERENT LIGHTS AND BACKGROUNDS

ReliTalk is a cool tech breakthrough that lets us make video avatars look natural even when you change the lighting or background. It uses a single video and the sound of your voice to create a 3D face model.

haonanqiu.com · 3 min

TLDR AI

CAN LLMS LEARN FROM A SINGLE EXAMPLE?

It appears that AI models were able to rapidly memorize examples from the dataset after seeing them just once. This astonishing feat contradicts most prior wisdom about neural network sample efficiency.

fast.ai · 10 min

TLDR AI

A NEW WAY TO TELL IF TWO SIMILAR PICTURES ARE REALLY THE SAME IN 3D

Doppelgangers is a new tech tool that helps figure out if two pictures that look almost the same are actually showing the same 3D object or not. It's smart enough to avoid mistakes that even people might make.

doppelgangers-3d.github.io · 3 min

TLDR AI

HOW THE AI REVOLUTION WILL RESHAPE THE WORLD

An argument that the impending technological wave, largely driven by AI, will herald a historic redistribution of power.

time.com · 4 min

TLDR AI

BUZZY AI STARTUP FOR GENERATING 3D MODELS USED CHEAP HUMAN LABOR

Kaedim, a 3D generation startup, often used human artists to make models, at one point using workers to produce the 3D design wholecloth themselves.

404media.co · 5 min

TLDR AI

OPENAI WILL HOST ITS FIRST DEVELOPER CONFERENCE ON NOVEMBER 6TH

OpenAI will host a developer conference, OpenAI DevDay, on November 6, the company announced today.

techcrunch.com · 2 min