LLAMAFILE, BUILD ONCE RUN ANYWHERE

Summary from the TLDR AI newsletter

llamafile is a combination of llama.cpp and Cosmopolitan libc. This means that you can target essentially any CPU on any OS and bundle your model in a single executable file.