THE NEW AMERICAN AI MODEL DESIGNED TO BE CUSTOMIZED

Summary from the TLDR AI newsletter

Thinking Machines released a model called Inkling in July. Inkling is the company's first model trained from scratch. Its weights are available on Hugging Face under an Apache 2.0 license. This article walks through the various choices Thinking Machines made while building Inkling. It covers the model architecture, position encoding, how images and audio enter the model without a separately pretrained encoder in front of them, the thinking effort setting, and more.