INTELLECT-1 RELEASE: THE FIRST GLOBALLY TRAINED 10B PARAMETER MODEL

Summary from the TLDR AI newsletter

INTELLECT-1 is a 10B parameter model trained on 1T tokens with hardware distributed around the globe. The benchmarks are reasonable, and the MFU of 30%+ is amazing given the distributed nature of training. If the results hold, this is a substantial improvement for decentralized large model training.