GPT IN 500 LINES OF SQL

Summary from the TLDR Web Dev newsletter

This article explains how GPT is built and then proceeds to implement it in SQL. Yes, SQL. ChatGPT itself couldn’t figure out how to implement GPT in SQL, but the author builds it step-by-step in about 500 lines. Each part of the implementation is explained, including the tokenizer, embeddings, and the attention mechanism.