SPEEDING UP TRANSFORMERS WITH TOKEN MERGING

Summary from the TLDR AI newsletter

This project introduces PiToMe, an algorithm that compresses Vision Transformers by progressively merging tokens after each layer. This method reduces the number of tokens processed.