UNIT SCALING FOR LOW PRECISION TRAINING

Summary from the TLDR AI newsletter

Graphcore released an excellent Pytorch library that makes training in fp8 super easy and stable. A single model wrapper and torch compile is all you need.