A SIMPLER CLIP FINE-TUNING

Summary from the TLDR AI newsletter

This paper introduces ProLIP, a method for adapting vision-language models like CLIP without adding extra parameters. By fine-tuning just the last projection matrix of the vision encoder, ProLIP achieves strong results in few-shot classification.