GAUSSIAN MASKED AUTOENCODERS

Summary from the TLDR AI newsletter

Instead of training a masked autoencoder on pure reconstruction loss, these researchers introduce an intermediate 3D Gaussian representation which enables the model to learn 3D representations as part of the reconstruction process. The results are compelling for zero-shot transfer tasks.