TLDR Index
TLDR AI

TLDR AI 2023-10-05

6 sections13 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

MICROSOFT CEO TESTIFIES ABOUT LIMITS OF AI AT GOOGLE ANTITRUST TRIAL

Microsoft CEO Satya Nadella testified in the U.S. antitrust case against Google, claiming Google's dominance in internet search is maintained through unfair tactics, including default agreements with Apple. Despite investments in AI and new features for Bing, Microsoft struggles to break Google's market stronghold. Nadella hinted that even with AI advancements, changing default habits might remain challenging.

archive.ph5 min read

03RESEARCH & INNOVATION

DEEP DIVE: RUNNING SDXL IN JAX ON TPU V5

SDXL is a state of the art image generation model. It is powerful, but slow. Google and HuggingFace showcase just how fast it can be on the new TPU chips in Google's research language Jax.

huggingface.co18 min read

REASONING

The recent work on registers for ViTs showed that adding a [reg] token fixes image attention map spikes. This work shows that adding a series of learnable [pause] tokens prepended to the sequence improves language model reasoning (decoder only, up to 1B) by as much as 18%. The intuition is that this adds a number of learnable and manipulatable vectors to store important global information to be used while generating the sequence. In general, adding tokens has scaled well past 13B parameters, but it's unclear how well this works at frontier model scale.

arxiv.org20 min read

KNOWLEDGE EDITING IN LLMS

Think of LLMs like big, intricate puzzles with pieces of knowledge. This paper looks at what happens if we try to change some of those pieces - it could either mess up the whole puzzle or make it unclear.

arxiv.org18 min read

04ENGINEERING & RESOURCES

DO LLMS WORK WELL TOGETHER LIKE HUMANS DO?

This paper studies how LLMs might work together in groups, just like people in a society. Researchers have made computer "societies" with different personalities and watched them team up on tasks, finding they sometimes act like humans - like following the majority or debating - and some teams work better than others.

arxiv.org16 min read

05MISCELLANEOUS

IS AI A PLATFORM SHIFT?

A platform shift alters the foundational layer of application development, influencing company dominance, architectures, and business models. Given its potential to change distribution and expand possibilities, AI is poised to become a significant platform shift, challenging existing structures and introducing new paradigms.

matt-rickard.com2 min read