A CHATGPT CLONE, IN 3,000 BYTES OF C, BACKED BY GPT-2

Summary from the TLDR Web Dev newsletter

This post goes through the creation of a ChatGPT clone in approximately 3,000 bytes of C code using the GPT-2 model. The program implements GPT-2's functionality, including tokenization, transformer architecture, and inference, using a custom linear algebra library.