The Daily Index — Tuesday, May 16, 2023 · TLDR Index

Across today’s newsletters

Today’s Index

TLDR AI

TOGETHER COMPUTE $20M SEED ROUND

Together compute is, among other things, building a cloud platform for efficient machine learning. With strong academic connections, and highly talented technologists, they have a good shot of building really useful tools for the ecosystem. One of their notable works to date is the release of the red pajama data set, which is an open replication of the closed data set used to train Llama.

together.xyz · 2 min

TLDR AI

MEGABYTE - MILLION BYTE SEQUENCES

Transformers are not actually end to end. There is a separate training process for the tokenizer which is strange and often leads to odd performance in general. However, if we try to naively train on bytes we quickly run out of context length given the increased length of sequences. Additionally for truly multimodal problems training directly on bytes removes complex patching and tokenization schemes. This work allows models to train directly on bytes with sequence lengths up to a million bytes. Maybe this will even help nucleus sampling for rare words too!

arxiv.org · 28 min

TLDR AI

VIDEO QUESTION ANSWERING

Visual question answering has seen massive adoption over the past several months, and rapid progress. Largely enabled by pre-trained models such as Blip and clip. Applying these models to video is challenging due to the dramatically increased computational requirements. This work introduces a cascade of different models that dramatically improves the robustness of these systems by operating at different timescales. They use Blip2 and find strong performance.

arxiv.org · 45 min

TLDR AI

ENHANCING 3D SCENE RECONSTRUCTION AND REALISM FROM LASER DATA

NFL is a new method that takes LiDAR data (a way of measuring distances using lasers) and creates realistic 3D scenes from new viewpoints. This technique works better than others and can help improve tasks like mapping and understanding the environment around us.

research.nvidia.com · 5 min

TLDR AI

UNCENSORED MODELS

Eric Hartford's blog post explores the implications of uncensored AI models, suggesting that AI censorship might be leading us down a risky path. He argues for the development of systems to better manage the outputs rather than suppressing them. He mentions that more research and dialogue are needed around the ethics of AI use, and proposes the idea of a multi-stakeholder governance model for AI systems.

erichartford.com · 10 min

TLDR AI

AMAZON PLANS TO ADD CHATGPT SEARCH

Amazon.com Inc. plans to bring ChatGPT-style product search to its web store, rivaling efforts by Microsoft Corp. and Google to weave generative artificial intelligence into their search engines.

archive.ph · 2 min

TLDR AI

MEET THE OPENAI ‘RED TEAM’

OpenAI used an eclectic mix of people, known as the ‘Red Team’, to ‘adversarially test’ GPT-4.

archive.ph · 4 min