TLDR Dev · MISCELLANEOUS
TWO BETS ON STANDING STILL, AND A DARK HORSE
Summary from the TLDR Dev newsletter
Taalas and Groq are two companies tackling the challenge of AI inference hardware, each taking a different approach. Taalas etches model weights directly into silicon for speed, while Groq maintains loadable model weights in SRAM to allow for flexibility.