DEEPMIND'S IMAGE-TEXT MODEL

Summary from the TLDR AI newsletter

DeepMind has introduced TIPS, a novel image-text model designed for dense and global vision tasks. By combining contrastive learning with masked image modeling and using synthetic captions, it achieves strong spatial awareness and outperforms existing approaches in multiple benchmarks.