TLDR AI · MISCELLANEOUS
TWO BETS ON STANDING STILL, AND A DARK HORSE
Summary from the TLDR AI newsletter
Taalas was a startup that etched models into silicon to speed up inference. Groq was also working on the same problem but stopped one step short, keeping the weights on the chip but still rewritable. Inside eight months, Nvidia had taken one of them and AMD the other. This indicates something significant is happening behind the scenes in the chip industry. Every time a workload has left general-purpose hardware, it permanently changed who could afford to run it.