TLDR AI · ENGINEERING & RESEARCH

OMNIVINCI ADVANCES OMNI-MODAL LLMS

nvlabs.github.io8 min read

Summary from the TLDR AI newsletter

OmniVinci is a multi-modal architecture with novel techniques for aligning and encoding image, video, audio, and text data. The 9B-parameter model outperforms Qwen2.5-Omni across perception benchmarks while requiring just a fraction of the training tokens.