TLDR AI 2023-03-07

GOOGLE’S UNIVERSAL SPEECH MODEL

AI IS BEING USED TO DETECT BREAST CANCER

MICROSOFT LAUNCHES COPILOT

Microsoft, having brought artificial intelligence to its battle with Google over search, is now turning to the latest AI technology to catch up with rivals in the corporate applications market such as Oracle, Salesforce, and SAP. Microsoft’s new AI “copilot” will help answer customer calls, summarize sales meetings, and generate marketing pitches.

HUMAN MOTION DIFFUSION AS A GENERATIVE PRIOR

The paper proposes a method to address the low availability of data in motion generation tasks by using a pre-trained diffusion-based model as a generative prior. The method includes a zero-shot setting that generates long animations with controlled transitions, a few-shot setting that generates two-person interaction, and a fine-tuning setting that enables fine-grained control and editing. The proposed method outperforms state-of-the-art approaches in quality scores and interaction levels in a user study.

IN-CONTEXT INSTRUCTION LEARNING

The paper presents a new approach to instruction learning called In-Context Instruction Learning (ICIL) that significantly improves the zero-shot task generalization performance of Large Language Models (LLMs). While previous approaches to instruction learning have been predominantly fine-tuning based, ICIL uses a single fixed prompt to evaluate all tasks, resulting in a 9.3% improvement in performance for the most powerful instruction-fine-tuned baseline. ICIL is shown to be complementary to instruction-based fine-tuning, making it a promising approach for improving zero-shot task generalization for LLMs.

STYLIZE YOUR FACE IN ONLY ONE-SHOT

The paper presents StyO, a new model for one-shot face stylization that combines content and style attributes from input images using disentanglement and recombination strategies. The model uses latent diffusion models and consists of two modules: Identifier Disentanglement Learner (IDL) and Fine-grained Content Controller (FCC). Evaluation results show that StyO outperforms current state-of-the-art methods in producing high-quality stylized face images.

FASTER MODEL INIT ON GPU

Loading language models to GPUs can be painfully slow, potentially minutes long. This is because they tend to load all the weights onto the CPU before transferring them to the GPU. Instead of this process, you can write an initialization context manager which puts the weights directly on the GPU - leading to pretty dramatic savings.

AN OPEN-SOURCE FRAMEWORK FOR IN-CONTEXT LEARNING

The authors introduce OpenICL, an open-source toolkit that facilitates In-Context Learning (ICL) and Large Language Model (LLM) evaluation. ICL is a new paradigm for LLM evaluation that adapts pre-trained models to unseen tasks without parameter updates. OpenICL provides a flexible architecture that users can easily combine with different components to meet their requirements. The toolkit also includes various state-of-the-art retrieval and inference methods, making it an efficient and robust tool for LLM evaluation on a wide range of Natural Language Processing (NLP) tasks.

WORDS AS IMAGE - SEMANTIC TYPOGRAPHY

Semantic Typography is where letters in a word are shaped in such a way to reflect the meaning of the word. So the A in Paris might look like the Eiffel tower. This is typically a very labor intensive process. However, using a differentiable renderer and a strong text-to-image prior, it is now feasible to automate some of this process. A delightful piece of work with fun visual examples included.

THE WALUIGI EFFECT

RECREATING FLAMINGO - RETROSPECTIVE

THOUSANDS SCAMMED BY AI VOICES

A DEEP DIVE INTO THE AI OBJECTIVE INSTITUTE

Inspired by digital-privacy pioneer Peter Eckersley, the AI Objective Institute is working toward guiding AI toward “human flourishing”

LLAMA INT8

LLaMA int8 is a fork of the LLaMA code that runs LLaMA-13B comfortably within 24 GiB of RAM.