MARKETPLACE: MY FIRST ATTEMPT AT TRAINING WITHOUT BACKPROP ON GPU EFFICIENTLY

Summary from the TLDR AI newsletter

People from a decade ago would hardly believe that we have an abundance of supercomputers in our homes. It's now possible to conduct end-to-end experiments in a solo project with modern hardware. We're entering into a new era of personal supercomputing. This article looks at an approach to training without backpropagation on GPUs efficiently - an experiment like this used to cost researchers an insane amount of money and resources just to test the idea.