GEOMETRIC FOLDING IN RELU NETWORKS

Summary from the TLDR AI newsletter

Researchers present a quantitative analysis of how ReLU neural networks fold input space, revealing self-similarity patterns. They introduce a novel metric to study these transformations and provide empirical results on benchmarks like CantorNet and MNIST.