90% FASTER B200 TRAINING

Summary from the TLDR AI newsletter

Together AI shares their great work improving training kernels. They use TorchTitan as a testing ground and find huge improvements by targeting the architecture.