TLDR AI · MISCELLANEOUS

NVIDIA'S LARGE MULTIMODAL MODEL (HUGGING FACE HUB)

huggingface.co

Summary from the TLDR AI newsletter

Nvidia did a really great ablation on different ways to include images into a language model. It found that the LlaVa concatenation approach performs the best.