TLDR AI · DEEP DIVES & ANALYSIS
AN OFF SWITCH FOR DUAL USE KNOWLEDGE IN AI MODELS
Summary from the TLDR AI newsletter
GRAM (Gradient-Routed Auxiliary Modules) enables the benefits of training many separately-filtered models at the cost of training only one model. It gives models dedicated, removable compartments for each category of dual-use knowledge and only updates those compartments when learning from dual-use data. It allows parts of the model's knowledge to be deleted after training, providing a stronger framework for model safety.