FINE-TUNING VISION TRANSFORMERS MORE EFFICIENTLY

Summary from the TLDR AI newsletter

Fine-tuning pre-trained vision models for specific tasks often requires a lot of extra computing power. Researchers have come up with a method called "Salient Channel Tuning" (SCT) that smartly picks which parts of a model to fine-tune, using way fewer extra settings and still outperforming other methods in almost all tested tasks.