TLDR · PROGRAMMING, DESIGN & DATA SCIENCE
GREPPING LOGS REMAINS TERRIBLE
Summary from the TLDR newsletter
Databases were created because scanning through raw data over and over again was inefficient and did not scale. This applies to logs just as much as any other kind of data. Programs should output to a log-ready database - this will make querying them require less computing power and RAM and take less time. It also enables aggregations, computations, build stats, and many other database functionalities.