TLDR · PROGRAMMING, DESIGN & DATA SCIENCE
SMALL DATA, BIG COMPUTE
Summary from the TLDR newsletter
The typical business analyst query significantly underutilizes compute. Large language models use a lot more compute and may bring on another expansionary era of bloat. Most companies will not have the budget to operate large language models on big data - most business use cases will inevitably operate on less than a million rows of data. The shift to small data will mean that data egress will no longer be a moat and open up an opportunity for new GPU cloud competitors to emerge.