TLDR AI 2023-05-26

OPENAI MAY LEAVE THE EU

OpenAI CEO Sam Altman said on Wednesday the company might consider leaving Europe if it could not comply with the upcoming AI regulations by the European Union.

MICROSOFT CALLS FOR AI REGULATION

Microsoft Corp. is calling for a new US agency to regulate artificial intelligence and licensing requirements to operate the most powerful AI tools, company President Brad Smith said Thursday.

ENHANCING DIFFUSION MODELS WITH REINFORCEMENT LEARNING

This paper investigates the use of reinforcement learning to optimize diffusion models for downstream objectives like image quality. The proposed approach, Denoising Diffusion Policy Optimization (DDPO), proves effective in adapting text-to-image models to challenging objectives and improving prompt-image alignment without additional data or human annotation.

RECURRENCE

This project introduces RECURRENTGPT, a language-based recurrence mechanism incorporated into large language models like ChatGPT. By simulating the Long Short-Term Memory mechanism, RECURRENTGPT enables arbitrary-length text generation while preserving long-term memory. It demonstrates potential for interactive writing systems and personalized interactive fiction, showcasing the utility of borrowing ideas from cognitive science and deep learning.

GOAT: SMALL MODELS BEAT GPT4 ON ARITHMETIC

To be fair, calculators also beat GPT4 on arithmetic. The interesting discovery here is that the llama tokenizer (which splits numbers into individual digits) provides benefits for arithmetic even over other similarly powerful base models fine-tuned in the same task.

TWIST: IMPROVING SPEECH LANGUAGE MODELS WITH TEXTUAL WARM-START

This work introduces TWIST, a method for training Speech Language Models (SpeechLMs) using a warm-start from pretrained textual models. TWIST outperforms starting from scratch, with empirical analysis emphasizing the significance of model and dataset scale. The study presents the largest SpeechLM to date and introduces spoken versions of a textual benchmark for improved evaluation and future research advancements.

GORILLA

Gorilla enables LLMs to use tools by invoking APIs. Given a natural language query, Gorilla comes up with the semantically- and syntactically- correct API to invoke.

HOW TO FINETUNE LLMS ON CUSTOM DATASETS

GRIMES REVIEWS AI GRIMES SONGS

AI-music proponent Grimes takes some time to review AI-generated Grimes songs, which she found quite impressive.

NVIDIA STOCK EXPLODES

CHATGPT PLUGINS NOW SUPPORT POSTGRES & SUPABASE

GOOGLE SEARCH STARTS ROLLING OUT AI RESULTS

TIKTOK TESTING AI CHATBOT

TikTok is testing an AI chatbot called Tako that can converse with users about short videos and help them discover content.

IX

Ix is an experimental platform for designing and deploying semi-autonomous LLM agents.