MSLK KERNEL REFERENCE

Summary from the TLDR AI newsletter

MSLK (Meta Superintelligence Labs Kernels) is a library of fused GPU kernels for transformer workloads. It contains a collection of high-performance kernels and optimizations built on top of PyTorch primitives for GenAI training and inference. MSLK is released in accordance with the PyTorch release schedule. There is no guarantee that each release works in conjunction with PyTorch releases that are older than the one that the MSLK release corresponds to.