The Daily Index — Monday, July 1, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

OPENAI STRIKES A DEAL WITH TIME

Time has signed a licensing deal with OpenAI, allowing the company's AI to train on 101 years of its journalism and access real-time content for answering user queries about breaking news. In return, OpenAI will cite Time and link back to its source material.

engadget.com · 2 min

TLDR AI

AMAZON INVESTIGATING PERPLEXITY AI OVER POTENTIAL DATA-SCRAPING VIOLATIONS

Amazon Web Services is investigating Perplexity AI for allegedly scraping data from websites without consent.

links.tldrnewsletter.com · 2 min

TLDR AI

DEEPDIVE: TRAINING MOES

The Mosaic team has partnered with PyTorch to write about scaling their MoE models to thousands of GPUs.

pytorch.org · 15 min

TLDR AI

TEXT2BRICK

Open Sora video model trained to make Lego movies by Lambda Labs on its 1-click cluster.

wandb.ai · 12 min

TLDR AI

MUMU VISION MODEL

Generative image model that can interleave text and images for stronger conditioning and higher performance than pure text conditioned models.

arxiv.org · 20 min

TLDR AI

IMPROVING AI'S WRITING SKILLS

Suri is a dataset of 20,000 long-form texts paired with complex instructions. It is designed to improve AI's ability to follow detailed writing constraints. The team that developed Suri has introduced Instructional ORPO (I-ORPO), an alignment method that uses synthetically corrupted instructions, for feedback.

chtmp223.github.io · 3 min

TLDR AI

CAMBRIAN-1

Fully open and high performing vision model from NYU with massive ablations to text encoders and data mixes.

cambrian-mllm.github.io · 8 min

TLDR AI

EXPRESSIVE TEXT-TO-SPEECH

DEX-TTS is a new model for expressive text-to-speech (TTS) that uses reference speech to improve style representation and model generalization.

arxiv.org · 16 min

TLDR AI

HELPFUL GUIDE TO DEBUGGING PYTORCH

PyTorch is a great tool for building models. However, there are some common bugs that can dramatically reduce model performance. This list is useful to review and can be helpful when debugging your model code.

uvadlc-notebooks.readthedocs.io · 8 min

TLDR AI

INVESTING IN THE AGE OF GENERATIVE AI

Despite being in a state of funding "euphoria", the Generative AI market is already experiencing some weakness.

eastwind.substack.com · 12 min