TLDR AI · ENGINEERING & RESOURCES

BITBLAS: OPTIMIZED KERNELS FOR 1.58 BIT NET

links.tldr.techGitHub repository

Summary from the TLDR AI newsletter

Microsoft has released a set of GPU accelerated kernels for training BitNet style models. These models have substantially lower memory cost without much drop in accuracy.