TLDR Index
TLDR AI

TLDR AI 2023-05-01

6 sections17 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

03RESEARCH & INNOVATION

INSTRUCTIONS

INSTRUCTCTG is a controlled text generation framework that incorporates various constraints by using natural language descriptions and demonstrations. This flexible approach maintains generation quality and speed, and allows the model to adapt to new constraints without retraining through few-shot task generalization and in-context learning.

arxiv.org11 min read

SCENES

This study presents a method for realistically inserting people into scenes while respecting scene affordances, using a self-supervised approach and a large-scale diffusion model. The model synthesizes more realistic human appearances and natural human-scene interactions compared to previous work, and enables interactive editing.

arxiv.org13 min read

04ENGINEERING & RESOURCES

LLAMA-ADAPTER V2

LLaMA-Adapter V2 is an improved, parameter-efficient model that enhances large language models' ability to follow instructions and incorporate visual knowledge. By optimizing learnable parameters and incorporating expert models, it performs better in multi-modal reasoning and chat interactions.

github.com3 min read

CHATVIDEO: A MULTIMODAL VIDEO UNDERSTANDING SYSTEM

ChatVideo is a prototype system for versatile and multimodal video understanding, using a tracklet-centric paradigm and Video Foundation Models (ViFMs) to annotate properties. This approach demonstrates effectiveness in addressing diverse video-related problems in real-world scenarios.

wangjunke.info4 min read

05MISCELLANEOUS