RUNNING GPT-2 IN WEBGL: REDISCOVERING THE LOST ART OF GPU SHADER PROGRAMMING

Summary from the TLDR Web Dev newsletter

GPT-2 can be implemented in WebGL using GPU shader programming. Early programmable shaders paved the way for general-purpose GPU (GPGPU) computing. This dev repurposed textures, framebuffers, and fragment shaders to perform neural network operations on the GPU, treating the graphics pipeline as a parallel engine.