TLDR AI · ENGINEERING & RESEARCH

HY3

simonwillison.net1 min read

Summary from the TLDR AI newsletter

Hy3 is a 295-billion-parameter Mixture-of-Experts model with 21 billion active parameters and 3.8 billion MTP layer parameters. Developed by Tencent, Hy3 outperforms similar-sized models and rivals flagship open-source models with two to five times more parameters. The full-sized model is available on Hugging Face. It is available for free on OpenRouter until July 21.