ADVANCING IMPLICIT NEURAL REPRESENTATIONS WITH RELU

Summary from the TLDR AI newsletter

Researchers have revisited the use of ReLU activation functions in learning implicit neural representations (INRs). Inspired by second-order B-spline wavelets, they introduced simple constraints to ReLU neurons to counter spectral bias.