TLDR AI 2023-06-21

OPENAI PLANS AN APP STORE

OpenAI plans to launch a marketplace that will allow developers to sell their AI models built on top of its own AI technology.

EMERGING ARCHITECTURES FOR LLM APPLICATIONS

OPENAI LOBBIED EU TO WATER DOWN REGULATION

DEEPMIND'S NEW ROBOTICS CONTROLLER

A NOVEL APPROACH TO COLLABORATIVE IMAGE RECOGNITION

PhotoBook is an interactive game in which two players find common images from their own private sets, pushing machines to learn human-like communication around visual context. The approach, based on the DeBERTa model and CLIPScore features, bypasses the need for reference chains, directly predicting whether an image is shared.

LOMO: EFFICIENT LLM TRAINING

This research introduces LOw-Memory Optimization (LOMO), an optimizer designed to dramatically decrease the resources needed for Large Language Models (LLMs) training, a process that currently requires extensive GPU resources. LOMO's innovative approach allows the fine-tuning of a 65 billion parameter model using just a single machine with 8 RTX 3090 GPUs, each with 24GB memory, reducing memory usage to just 10.8% of the standard method.

CLIP2PROTECT: A METHOD FOR PROTECTING FACIAL PRIVACY

The Clip2Protect project introduces an innovative two-step approach to ensure facial privacy, especially in an age of powerful face recognition systems. It creates 'makeup' faces that look natural, yet fool facial recognition software, showing significantly better performance than previous privacy-enhancing methods.

AUTOLABEL

Autolabel is a Python library to label, clean and enrich text datasets with any Large Language Models (LLM) of your choice.

ASSET MANAGERS PRESSURE TECH COMPANIES OVER AI MISUSE

Institutional investors are increasing pressure on technology companies to take responsibility for the potential misuse of artificial intelligence as they become concerned about the liability for human rights issues linked to the software.

NEED TO DEDUP LOTS OF DATA?

The quality of the training mix for AI models is key to getting good performance. In code models, deduplication of data tends to matter quite a bit. It's not clear if it matters as much for text. However, in any case, this blog presents a great description of the techniques used to deduplicate large data sets of text-like data.

WHAT I LEARNT AFTER WRITING 25+ ARTICLES BY USING AI

AI should be used as a tool to enhance productivity, imagination, and creativity, and not as a means of automation. This article provides insights on how to use AI without sacrificing quality.

ENCODEC IN HUGGINGFACE TRANSFORMERS

OPERA PREPARES AI-INFUSED BROWSER

QUIVR

Dump all your files and thoughts into your GenerativeAI Second Brain and chat with it.