TLDR · PROGRAMMING, DESIGN & DATA SCIENCE

GREPPING LOGS REMAINS TERRIBLE

chronicles.mad-scientist.club7 min read

Summary from the TLDR newsletter

Databases were created because scanning through raw data over and over again was inefficient and did not scale. This applies to logs just as much as any other kind of data. Programs should output to a log-ready database - this will make querying them require less computing power and RAM and take less time. It also enables aggregations, computations, build stats, and many other database functionalities.