CLIP TRAINED ON FULLY SYNTHETIC DATA

Summary from the TLDR AI newsletter

The removal of large-scale datasets such as LAION, along with valid copyright concerns, makes training large-scale image models challenging. This work shows that you can train a powerful CLIP model with 30 million synthetically generated images.