ARTISANAL SHIMS FOR THE BITTER LESSON AGE

Summary from the TLDR AI newsletter

General methods that leverage computation are ultimately the most effective by a large margin. Developers building and working with AI applications should be aware that the artisanal architecture they are building may become obsolete with the next model release. They should make a note of what is not scaling with compute and focus their artisanal ingenuity there. Custom architectures may be necessary for many applications, but build them with the knowledge that they may have to be thrown away when the next frontier model drops.