TLDR Dev · QUICK LINKS

REPLACING A 3 GB SQLITE DATABASE WITH A 10 MB FST (FINITE STATE TRANSDUCER) BINARY

til.andrew-quinn.me9 min read

Summary from the TLDR Dev newsletter

Transitioning a Finnish-English dictionary from a 3 GB SQLite database to a 10 MB finite state transducer reduced its storage requirements by 300x by using the data structure's ability to efficiently compress the frequent prefix and suffix patterns found in such languages.