A LONG-CONTEXT OPEN-WEIGHT LANGUAGE MODEL

Summary from the TLDR AI newsletter

Giraffe introduces a transformer-based architecture capable of processing significantly longer input contexts, pushing the boundaries of context length in open-weight models.