ALL YOU NEED ARE 32 TOKENS TO REPRESENT VIDEO

Summary from the TLDR AI newsletter

Salesforce's new method uses a novel encoder for video that requires substantially fewer tokens for proper representation. This has been tried a number of times in the past with minimal success, the key seems to be an explicit temporal encoder along with a spatial encoder.