META UNVEILS MUSE SPARK OPEN, THE NEW TOP US OPEN WEIGHTS MODEL — AND IT RUNS ON TWO PAIRED MAC DESKTOPS

Summary from the TLDR newsletter

Muse Spark Open is an 816-billion-parameter open-weight model that can run on relatively affordable consumer hardware. Meta's benchmark tests used a pair of M5 Ultra Mac Studios with an unknown memory configuration. The model uses a mixture-of-experts design and activates 42 billion parameters for each token. It supports a context of up to 1 million tokens and accepts text, images, video, and audio, but only outputs text.