TLDR AI 2023-03-14

ALPACA: A STRONG OPEN-SOURCE INSTRUCTION-FOLLOWING MODEL

Instruction-following models such as GPT-3.5 (text-davinci-003), ChatGPT, Claude, and Bing Chat have become increasingly powerful. However, instruction-following models still have many deficiencies: they can generate false information, propagate social stereotypes, and produce toxic language. To make maximum progress on addressing these pressing problems, it is important for the academic community to engage. Alpaca is a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.

TOGETHER RELEASES OPENCHATKIT

OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots for various applications. OpenChatKit is Together’s version of OpenAI’s ChatGPT. All of the model’s weights, code, and training data are available online. And it was even trained on 100% carbon-negative compute.

JENSEN'S INEQUALITY

An extremely useful inequality for applied mathematicians and machine learning practitioners. This post explores this often backwards, but useful, inequality. If you're hoping to learn more of the math behind ML, this is a good piece to read.

UNALIGNED FACE MANIPULATION

This paper proposes a solution to the limitations of StyleGAN, which is restricted to cropped aligned faces at fixed image resolution. The solution involves using dilated convolutions to rescale the receptive fields of shallow layers in StyleGAN without altering model parameters, resulting in features that can accommodate variable resolutions and better characterize unaligned faces. Additionally, the paper introduces an encoder that provides the first-layer feature of the extended StyleGAN and validates the effectiveness of the method in various face manipulation tasks, including super-resolution, facial attribute editing, sketch/mask-to-face translation, and face toonification.

MVIMGNET: A LARGE-SCALE DATASET OF MULTI-VIEW IMAGES

The authors introduce MVImgNet, a large-scale dataset of multi-view images for 3D vision. It contains 6.5 million frames from real-world objects and bridges the gap between 2D and 3D vision. MVPNet, a 3D object point cloud dataset, is also introduced.

HYPER LIGHT SPEED GPT

Based on the NanoGPT repo, this code can train a decoder only transformer model to somewhat reasonable perplexity in just 3 minutes. It is designed to be simple to understand, hackable, with fast convergence for researchers to explore their ideas.

GUARDRAILS

Guardrails is a Python package that lets a user add structure, type, and quality guarantees to the outputs of LLMs.

WHISPERBOARD

Whisperboard is an iOS app for recording and transcribing audio on the go, based on OpenAI’s Whisper model.

THE HOT MESS THEORY OF AI MISALIGNMENT

GPT-4 UPGRADE WILL INCLUDE TEXT-TO-VIDEO

According to Microsoft Germany CTO Andreas Braun, OpenAI’s upcoming GPT-4 upgrade will allow users to turn text into video. Braun added that the more powerful AI will be introduced this week, putting an end to speculation over its release. "We will introduce GPT-4 next week, where we will have multimodal models that will offer completely different possibilities – for example, videos," Braun said.

AI CAN FORECAST THE NEXT FOOD CRISIS

GM PLANS TO LET YOU TALK TO YOUR CAR WITH CHATGPT

CHATGPTNET

ChatGPTNet is a ChatGPT integration library for .NET