TLDR AI · ENGINEERING & RESOURCES
BITBLAS: OPTIMIZED KERNELS FOR 1.58 BIT NET
Summary from the TLDR AI newsletter
Microsoft has released a set of GPU accelerated kernels for training BitNet style models. These models have substantially lower memory cost without much drop in accuracy.