TLDR AI

TLDR AI 2023-07-03

5 sections14 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

EUROPEAN COMPANIES SLAM THE EU’S AI ACT

Some of the biggest companies in Europe have taken collective action to criticize the European Union’s recently approved artificial intelligence regulations, claiming that the Artificial Intelligence Act is ineffective and could negatively impact competition.

theverge.com3 min read

ROUNDS MEAN GREAT WEEK FOR GENERATIVE AI

Shared more for the insightful take on Casetext, the overnight success that took a decade to build, this article gives some perspective on how transformative AI can be and how when the opportunity arises, you have to seize it.

newcomer.co5 min read

02RESEARCH & INNOVATION

1 MILLION TOKENS IN CONTEXT HELPS DNA TASKS

State space models have made a splash recently. They arose as a potentially useful model alternative by sidestepping some challenging aspects of the Transformer while maintaining performance. In this work, the Hyena model is applied to DNA sequence modeling and improves in 23 tasks.

hazyresearch.stanford.edu8 min read

A MORE EFFICIENT WAY TO TRAIN A CLIP MODEL

CLIPA-v2 improves the efficiency of image-text matching models like CLIP by using shorter sequences, achieving a zero-shot ImageNet accuracy of 81.1% for just $10,000.

arxiv.org6 min read

MULTIVIEW DIFFUSION

This work allows you to take a single image and a pre-trained generative model to produce a panorama or multiple views of the image.

mvdiffusion.github.io6 min read

03ENGINEERING & RESOURCES

GPT-MIGRATE

GPT-Migrate enables you to easily migrate your codebase from one framework or language to another.

github.comGitHub repository

A NEW METHOD FOR BETTER MEDICAL IMAGING WITH LIMITED DATA

This study introduces 'Volume Fusion' (VF), a new way to train 3D medical imaging models without needing large amounts of pre-labelled data. The research showed that VF, combined with a new network structure, improved the accuracy of medical image interpretation for different body parts.

github.comGitHub repository

This research presents a method called Filtered Guided Diffusion (FGD) that enhances Image-to-Image (I2I) translation without requiring extra training or changes to the underlying model. FGD adjusts the diffusion process based on previous steps and offers significant improvements in structural guidance and performance.

github.comGitHub repository

04MISCELLANEOUS

LLM TRAINING PUZZLES

While we are all waiting for our 22k H100s to be delivered, we should probably practice training large models. Sasha Rush has another set of puzzles, but instead of GPUs or tensor shapes, he walks us through model parallelism, gradient accumulation, and more!

github.comGitHub repository

THE RISE OF THE AI ENGINEER

The article discusses the rise of AI engineering as a specialized field and the skills required to thrive in this domain, highlighting the need for a strong understanding of machine learning algorithms, data manipulation, and programming languages, as well as the ability to bridge the gap between research and implementation in order to create practical AI solutions.

latent.space6 min read

WHICH MODELS COMPLY WITH EU PRIVACY?

It is well known that Europe has stronger privacy requirements for many digital applications. This includes AI and language models. Unfortunately, many of the model providers today don't fully comply with these privacy requirements. This post explores where they fall short and which ones are the closest to full compliance.

crfm.stanford.edu13 min read