DETECTION THROUGH REASONING

Summary from the TLDR AI newsletter

When detecting objects in a scene, you usually pull from a set of predefined classes. Also, asking questions about the scene is challenging. In this case, we can use powerful language models (Vicuna) with instruction tuned detectors to reason about queries and detect objects as a result.