TLDR InfoSec · LAUNCHES & TOOLS
NANOCHAT LETS YOU BUILD YOUR OWN HACKABLE LLM
Summary from the TLDR InfoSec newsletter
Andrej Karpathy's nanochat is an open-source project that enables the creation of a simple ChatGPT clone for approximately $100 using 8,000 lines of minimal-dependency code and a single speedrun.sh script, producing a 1.9 billion parameter model trained on 38 billion tokens in about 4 hours on NVIDIA 8XH100 GPU hardware. The accessible codebase allows security researchers and developers to experiment with LLM architecture, understand model training processes, and test modifications without commercial platform restrictions, with scaling to $1,000 enabling significantly more capable models for math, coding, and reasoning tasks. This transparent, hackable approach provides security professionals with valuable insight into LLM internals for threat modeling, adversarial testing, and understanding AI system vulnerabilities that commercial black-box models obscure.