HOW DO MACHINES ‘GROK' DATA?

Summary from the TLDR Web Dev newsletter

Researchers have discovered that overtrained neural networks can develop unexpected and innovative solutions to problems, a phenomenon they have termed “grokking". These grokked networks solve problems like modular arithmetic using mathematical manipulations that mimic trigonometric functions.