TLDR AI

TLDR AI 2023-12-22

5 sections18 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

RITE AID BANNED FROM USING FACIAL RECOGNITION

Rite Aid used facial recognition software that falsely identified shoplifters, leading to dramatic confrontations. The FTC is cracking down more on this technology.

techcrunch.com5 min read

02RESEARCH & INNOVATION

ULTRAFAST 3D RECONSTRUCTION FROM A SINGLE IMAGE

Gaussian Splatting has pushed 3D reconstruction forward. However, it often requires 200+ images of an object for accurate reconstruction. This work moves to a single monocular image and a learning-based technique that maps each pixel of the image into a 3d gaussian. The cool novel piece here is the introduction of the “Splatter Image,” which encodes 3D information for downstream rendering.

szymanowiczs.github.io4 min read

POWERINFER FOR LLMS ON CONSUMER GPUS

This paper explores the idea that models have hot neurons used for almost all inputs and cold neurons that are used much less often. By preloading the hot neurons to the GPU, you can save memory without sacrificing much throughput. A companion code library is available.

arxiv.org12 min read

IMAGE GENERATION WITH SEQUENCE-AWARE LOSS

Researchers have developed a 'sequence-aware' loss function to improve Denoising Probabilistic Models (DPMs), addressing the issue of timestep correlation in image generation. This new approach not only offers a tighter estimation of loss but also shows significant improvements in image quality on datasets like CIFAR10 and CelebA, as evidenced by better FID and Inception Scores.

arxiv.org17 min read

03ENGINEERING & RESOURCES

LLAMA RECIPES

A set of tools, resources, and examples for using the Llama series of models from Facebook.

github.comGitHub repository

A ZERO-SHOT SEMANTIC SEGMENTATION

The new CLIP-DINOiser method combines the zero-shot capabilities of the CLIP model with self-supervised features for improved semantic segmentation without annotations.

wysoczanska.github.io3 min read

LLAVA INTERACTIVE

Llava is a strong multimodal model. This interactive design now allows chat style interleaving of text, image input, and image output.

llava-vl.github.io4 min read

04MISCELLANEOUS

YEAR ONE OF GENERATIVE AI: SIX KEY TRENDS

AI has been in the spotlight throughout 2023. As we round out the year, what’s really happened? This article highlights the key trends that have defined AI in 2023.

foundationcapital.com12 min read

MARKETPLACES IN THE AGE OF AI

Marketplaces have been a dominating business model over the last two decades. Here’s a breakdown from a16z sharing their thoughts on how AI will impact this company type. The central theme is about personalizing the experience for both sides of the marketplace.

a16z.com8 min read

IMPROVING TEXT IN AI-GENERATED IMAGES

UDiffText is a new method that enhances the quality of text in AI-generated images. By using a specialized text encoder and fine-tuning with a large dataset, UDiffText significantly reduces spelling errors and improves text accuracy.

udifftext.github.io4 min read