TLDR · QUICK LINKS
HOW TO SCALE YOUR MODEL
Summary from the TLDR newsletter
Model scaling increases the number of chips used for training or inference, which usually decreases computation time, but at the cost of added communication between chips.
TLDR · QUICK LINKS
Model scaling increases the number of chips used for training or inference, which usually decreases computation time, but at the cost of added communication between chips.