TLDR AI · MISCELLANEOUS
NVIDIA'S LARGE MULTIMODAL MODEL (HUGGING FACE HUB)
Summary from the TLDR AI newsletter
Nvidia did a really great ablation on different ways to include images into a language model. It found that the LlaVa concatenation approach performs the best.