TLDR Index
TLDR

TLDR 2023-05-15

5 sections13 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01BIG TECH & STARTUPS

02SCIENCE & FUTURISTIC TECHNOLOGY

03PROGRAMMING, DESIGN & DATA SCIENCE

FIRST-PRINCIPLES ON AI SCALING

Scaling laws indicate that Large Language Models (LLMs) will get substantially better at predicting words with the addition of more data and computational power. However, while it might be feasible to increase dataset size, there are potential barriers to making them more than 10 times larger than their current state, such as cost. Scaling LLMs to maximum potential would cost substantially more than the GDP of the planet with current technology. There is likely a computational limitation. Current scaling laws could be inaccurate due to the small amount of data and computation used to fit the model.

dynomight.net31 min read

04MISCELLANEOUS

theverge.com33 min read