REWRITING PYTORCH NN IN TRITON

Summary from the TLDR AI newsletter

Attorch is an attempt to rewrite portions of PyTorch’s nn module in Python and Triton. It is designed to be an easily hackable and performant neural network experimentation library. It is important to note that this would have been prohibitively expensive to write only a few years ago.