FABLE & THE END OF THE FREE LUNCH

Summary from the TLDR newsletter

When Moore's Law was in full effect, it didn't make sense to ruthlessly optimize code, as a new CPU would arrive in 18 months that would double performance. Developers only started to have to think about parallelization, architecture, memory locality, etc, after Moore's Law started slowing down in the mid-2000s. Prior to Fable, it felt like a waste to spend too much time improving coding harnesses or context strategies, as a new model would arrive at the same price or cheaper in just a few months that would cover most of the problem. Fable is incredible, but the cost is so high that developers are now starting to think about what work should go where and optimizing their harnesses to provide weaker models with sufficient context to perform well.