ENHANCING VISION-LANGUAGE MODELS WITH PROMPTS

Summary from the TLDR AI newsletter

This project introduces a method to adapt CLIP-like vision-language models for various tasks while retaining its generalization ability. The approach learns prompts from LLM data, avoiding the need for labeled images.