The Daily Index — Tuesday, July 4, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

RUNWAYML RAISES $141M SERIES C EXTENSION

This short announcement shows that RunwayML is still dedicated to building creative tools. Much of it will go to fund internal R&D.

runwayml.com · 1 min

TLDR AI

CLASSIFIER-FREE GUIDANCE FOR LANGUAGE MODELS

If you're looking for interesting trends in AI today, the idea of decoding tokens in new ways is an avenue of active research. Currently, each model gives the same amount of compute to each token, and the sampling method is somewhat simple. If we can improve sampling and guidance, we may be able to dramatically improve performance without retraining. This paper suggests that we can double our effective model size just by using classifier free guidance, which was first explored in the context of text to image diffusion models.

huggingface.co · 21 min

TLDR AI

A NEW FRAMEWORK TO DETECT ANY DEEPFAKES

This research presents a new system called Detect Any Deepfakes (DADF) for improved detection and precise location identification of manipulated facial images (deepfakes). Using the Segment Anything Model (SAM) and incorporating a multiscale adapter and Reconstruction Guided Attention (RGA), DADF improves deepfake detection performance.

arxiv.org · 21 min

TLDR AI

HUMAN BRAIN ACTIVITY

Researchers have proposed a new method using a diffusion model, specifically a latent diffusion model (LDM) named Stable Diffusion, for reconstructing high-resolution, high-fidelity images from human brain activity captured via fMRI. The method, which reduces computational cost while maintaining generative performance, does not require extra training or fine-tuning of complex deep learning models. The study also gives a neuroscientific interpretation of different LDM components, presenting a promising new approach to understand how our brain represents visual experiences.

sites.google.com · 12 min

TLDR AI

CREATING 3D SHAPES FROM 2D IMAGES AND TEXTS

This project introduces a method to generate 3D shapes from 2D images or texts, reducing inconsistencies that result from the dimensional differences. The method uses a two-model framework, the Shape-Image-Text-Aligned Variational Auto-Encoder (SITA-VAE) and Aligned Shape Latent Diffusion Model (ASLDM), to map the 3D shapes into a space that aligns with images and texts.

neuralcarver.github.io · 4 min

TLDR AI

OPENAI’S CODE INTERPRETER IS ABOUT TO REMAKE FINANCE

This article details a breakthrough in artificial intelligence automation for accounting minutiae due to a ChatGPT plug-in called Code Interpreter and how it could potentially revolutionize the way finance knowledge work is completed.

every.to · 9 min

TLDR AI

TECH WORKERS ARE SCRAMBLING TO BECOME AI EXPERTS

As AI continues to grow in importance, tech workers are scrambling to learn new skills in order to stay relevant in the job market. Many are turning to boot camps, online courses, and self-education in order to gain the AI skills that employers are increasingly seeking.

vox.com · 4 min