INSTRUCT BLIP

Summary from the TLDR AI newsletter

Blip is a model developed by Salesforce that can be used for vision and language tasks. Following the line of work in language models that tunes them to follow instructions, we can also tune these vision language models to follow instructions. This dramatically improves the performance, and in this case it even outperforms the published numbers of GPT-4.