TLDR AI · RESEARCH & INNOVATION

LONG(ER) CONTEXT MISTRAL MODEL

huggingface.co3 min read

Summary from the TLDR AI newsletter

Amazon enters the open source LLM game with a RoPE fine-tuned Mistral 7B that scales up to 32k tokens in context.