TLDR AI 2023-03-15

OPENAI RELEASES GPT-4

It’s finally here! GPT-4 is a smarter, safer, and more robust version of its predecessor. GPT-4 is safer and more aligned, but still has limitations. It is 82% less likely to respond to requests for disallowed content and 40% more likely to produce factual responses than GPT-3.5 based on internal evaluations. Companies like Duolingo, Khan Academy, and Stripe are already using the service. Also, a correction from yesterday’s newsletter: previous rumors that GPT-4 will include text-to-video capabilities are actually not true. GPT-4 has not yet made the leap to multimodal outputs like video, but it can take in both video and text as inputs!

GOOGLE UNVEILS NEW PALM API AND MAKERSUITE TOOL

ANTHROPIC LAUNCHES CLAUDE

NEW PRE-TRAINING PARADIGM IMPROVES LANGUAGE MODELS' CAPABILITIES

This paper proposes a new pre-training paradigm that improves the training data efficiency and capabilities of language models in the infilling task. The paradigm includes a bidirectional training objective that aligns the predictions of left-to-right and right-to-left LMs and a bidirectional inference procedure. The approach is evaluated on programming and natural language models and outperforms strong baselines.

MODEL-TUNING VIA PROMPTS: IMPROVING ADVERSARIAL ROBUSTNESS IN NLP

The MVP method demonstrates surprising gains in adversarial robustness, improving performance against adversarial word-level synonym substitutions by an average of 8% over standard methods, and even outperforming state-of-art defenses by 3.5%. By modifying the input with a prompt template instead of modifying the model by appending an MLP head, MVP achieves better results in downstream tasks while maintaining clean accuracy.

DISTRIBUTION FITTING

UniDiffuser is a framework for fitting all distributions relevant to multi-modal data in one model. It achieves this by unifying diffusion models for marginal, conditional, and joint distributions. UniDiffuser is able to perform image, text, text-to-image, image-to-text, and image-text pair generation with high-quality results and competitive quantitative scores.

UNIDIFFUSER

UniDiffuser is a unified diffusion framework to fit all distributions relevant to a set of multi-modal data in one model.

WRITEOUT.AI

Writeout.ai translates audio files using OpenAI’s Whisper API.

MICROSOFT HAS LAID OFF ONE OF ITS RESPONSIBLE AI TEAMS

GOOGLE ANNOUNCES NEW AI FEATURES FOR WORKSPACE

ADVISORS

THE AGE OF INFINITE MISINFORMATION HAS ARRIVED

In this article, Gary Marcus makes the case that bad actors could seize on large language models to engineer falsehoods at unprecedented scale.