TLDR AI

TLDR AI 2023-05-12

5 sections15 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

STABILITY AI TEXT TO ANIMATION

SDK released to allow users to create animations using stable diffusion models. You can generate these animations unconditionally, conditioned in an image, or conditioned on a video. The results are lovely, are somewhat computationally expensive, and have a very distinctive style.

stability.ai2 min read

02RESEARCH & INNOVATION

CREATING BETTER VIDEO CONTENT USING AI AND SKETCHES

This paper describes a new way to make video content using artificial intelligence (AI), based on sketches and text. The method, which combines two technologies called Text-to-Video Zero and ControlNet, can create high-quality, consistent videos that closely match what the user intended, as demonstrated by various experiments.

arxiv.org5 min read

DIFFUSION-BASED 3D FACIAL RECONSTRUCTION FROM A SINGLE IMAGE

This paper introduces a method that uses diffusion models, which have been successful in creating images, to reconstruct 3D facial features from just one image. The process involves using a dataset of facial textures, simulating various lighting conditions, and then using the diffusion model to fill in missing parts of the texture and unknown reflective properties, resulting in a more accurate and consistent 3D face.

arxiv.org12 min read

AN IN-DEPTH LOOK AT TEXT-TO-3D: THE NEW FRONTIER IN GENERATIVE AI

This paper is a comprehensive survey of the emerging field of text-to-3D, a part of generative AI that turns written descriptions into 3D models. It introduces different types of 3D data, foundational technologies, and how they're combined in recent works, as well as how text-to-3D is used in various applications like creating avatars and generating scenes.

arxiv.org28 min read

03ENGINEERING & RESOURCES

HUGGINGFACE CHAT UI

HuggingFace has open sourced the codebase powering the HuggingChat app, a competitor to ChatGPT.

github.comGitHub repository

VIDEOCHAT: A NEW SYSTEM FOR UNDERSTANDING VIDEOS BETTER

This repo introduces VideoChat, a system that makes sense of videos by combining artificial intelligence techniques for understanding videos and language. The researchers also created a large set of videos with detailed descriptions and conversations to help train the system to be better at understanding the sequence of events and cause-effect relationships in videos.

github.comGitHub repository

EVA

EVA is designed for supporting database applications that operate on both structured (tables, feature vectors) and unstructured data (videos, podcasts, PDFs, etc.) using deep learning models.

github.comGitHub repository

04MISCELLANEOUS

EU CONSIDERING TOUGHER AI RULES

European lawmakers came a step closer to passing new rules regulating artificial intelligence tools such as ChatGPT, following a crunch vote on Thursday. The European Union's highly anticipated AI Act is set to be the first comprehensive legislation governing the technology, with new rules around the use of facial recognition, biometric surveillance, and other AI applications.

archive.ph2 min read

WILL AI BECOME THE NEW MCKINSEY?

In this article, Ted Chong dives into the question of AI’s future in the economy, specifically its potential negative impacts on the workforce.

archive.ph11 min read