VIDEO LLAVA

Summary from the TLDR AI newsletter

LLaVa is a recipe for training a multi-modal model from a text model. It can now work with video. The resulting model (based on Vicuna) is extremely powerful and easily achieves state-of-the-art performance in video summarization and captioning.