MOVA: A NEW MULTIMODAL LANGUAGE MODELS

Summary from the TLDR AI newsletter

MoVA is a multimodal large language model (MLLM) that improves image content understanding by selectively integrating different vision encoders. It addresses the limitations of current encoders like CLIP by using a context-aware expert routing strategy and a mixture-of-vision-expert adapter to dynamically fuse expertise from various sources.