CRITICAL BITS IN NEURAL NETWORKS

Summary from the TLDR AI newsletter

Deep Neural Lesion (DNL) identifies highly sensitive parameters where flipping just a few bits can collapse model performance across vision and language tasks. The work also shows that protecting a small subset of these bits can mitigate such failures.