RWKV LAUNCHES EAGLE 7B

Summary from the TLDR AI newsletter

RWKV is an architecture alternative to the dominant Transformer model. It uses a novel linear attention mechanism that makes it extremely efficient. This new checkpoint and configuration was trained on 1T tokens and surpases many other powerful 7B Transformer based models.