PARSING JSON AT TENS OF GIGABYTES PER SECOND… IN PYTHON

Summary from the TLDR Data newsletter

Daniel Lemire's benchmark processed 7.6 GB of JSON in about 0.12 seconds using fastsimdjson on free-threaded Python across 64 cores, reaching roughly 66 GB/s. The speed comes from running threads in parallel and creating Python objects only for the fields needed, with data already decompressed in memory.