TLDR AI

TLDR AI 2024-01-19

5 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

OPENAI ANNOUNCES FIRST PARTNERSHIP WITH A UNIVERSITY

OpenAI has announced its first partnership with a higher education institution, Arizona State University, which will gain full access to ChatGPT Enterprise for coursework, tutoring, research, and more, including building a personalized AI tutor and creative AI avatars for students.

cnbc.com2 min read

MARK ZUCKERBERG’S NEW GOAL IS CREATING AGI

Mark Zuckerberg, Meta's CEO, is entering the race to develop artificial general intelligence (AGI), aiming to enhance Meta's apps and user experience. He emphasizes the need for AI talent and computing power and is considering an open-source approach to AI development, contrasting with the more closed methods of other companies.

theverge.com5 min read

02RESEARCH & INNOVATION

FOUNDATIONS OF VECTOR RETRIEVAL (2 HOUR READ)

This massive document outlines essentially everything one would need to know about the state of the vector retrieval field. It is a valuable resource that will take some time to dig through.

arxiv.org

PRETRAINING OF LARGE IMAGE MODELS

Apple has released a great paper on pretraining image models with an autoregressive loss. It measures scaling behavior and finds that like in language, these large unsupervised image models have very predictable behavior.

github.com12 min read

TEXT-TO-IMAGE EDITING

This paper improves how images are edited using natural language instructions by tackling challenges like unclear instructions and identifying specific parts of the image to edit.

arxiv.org15 min read

03ENGINEERING & RESOURCES

Sponsored

🆕 MOCKGPT: SIMULATE THE OPENAI API FOR TESTING AND DEVELOPMENT

Developing against OpenAI APIs can be finicky and expensive. MockGPT by WireMock [10] is a readymade mock API for ChatGPT, GPT-3.5, etc. Use it to write and test your code without fees and frustrating wait times — and switch one line of code to go live with the real API.

wiremock.ioSponsor

3D OBJECT PLACEMENT IN IMAGE GENERATION

Compose and Conquer introduces a conditional diffusion model that excels in placing objects in three-dimensional space within generated images.

github.comGitHub repository

MINUTE-LEVEL VIDEO BLOG CREATION

Vlogger is an advanced AI system capable of generating minute-long video blogs (vlogs) from user descriptions. Vlogger operates in four stages - Script, Actor, ShowMaker, and Voicer, each representing a specific aspect of vlog creation.

github.comGitHub repository

04MISCELLANEOUS

8BIT HIPPO ATTENTION MAY BE 3X FASTER THAN FLASH ATTENTION V2

A quantization-aware attention alternative that speeds up inference substantially over some state-of-the-art implementations. Its creators also claim 700 TFLOPs on MI-300X. The details are sparse, but it would be quite an achievement if so.

blog.hippoml.com4 min read

MEGA DOLPHIN PASS THROUGH MERGE

Dolphin is widely considered to be one of the strongest uncensored open models available. It is mainly built on Mixtral. This 120B model was made by merging two smaller Dolphin models together. It has been found, with Goliath 120B, that this merging process can improve overall model performance.

huggingface.co4 min read

NEW BENCHMARK FOR CODE GENERATION

TACO is a new benchmark for assessing a system’s ability to generate code. It is substantially larger than existing datasets and contains more challenging problems. On easy problems, GPT-4 gets 30% correct, while it only achieves 2% on the hardest subset of questions.

github.comGitHub repository