RELEASE: POWER ATTENTION

Summary from the TLDR AI newsletter

Manifest AI has open-sourced Power Attention, which replaces Flash Attention in any transformer.