TREE ATTENTION

Summary from the TLDR AI newsletter

This is an extension of Ring Attention, which allows for extremely long context by scaling across multiple GPUs. The researchers derive an energy function to inform how models should be sharded.