TLDR AI · ENGINEERING & RESOURCES
REACT HOOK TO RUN LLM IN THE BROWSER
Summary from the TLDR AI newsletter
With the advent of WebGPU, you can now run hardware accelerated workflows in the browser. This repository exposes a React hook that downloads the model from the HuggingFace CDN, compiles to WASM, and runs inference.