FUYU-HEAVY MULTIMODAL MODEL OUTPERFORMS GEMINI PRO

Summary from the TLDR AI newsletter

Adept scaled up its Fuyu architecture and trained a larger version that is currently the 3rd best model on MMMU. The model also performs well on other tasks (e.g., achieving 40+ on HumanEval coding benchmark). There were fewer challenges with scaling this architecture than alternatives, in part due to its simplicity. However, there were still challenges with data i/o, memory bandwidth, and custom kernel development.