TLDR AI

TLDR AI 2023-05-15

6 sections15 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

02HEADLINES & LAUNCHES

03RESEARCH & INNOVATION

INSTRUCT BLIP

Blip is a model developed by Salesforce that can be used for vision and language tasks. Following the line of work in language models that tunes them to follow instructions, we can also tune these vision language models to follow instructions. This dramatically improves the performance, and in this case it even outperforms the published numbers of GPT-4.

arxiv.org33 min read

ENHANCING IMAGE QUALITY WITH PRIOR KNOWLEDGE

A new technique has been created that enhances the quality of blurry images using pre-set text-to-image models. This method smartly uses a special encoder and doesn't need to change the existing image-making model, saving training time. Plus, users can control image quality with one simple adjustment. The strategy also handles larger images better than previous methods. Tests with both artificial and real-world images prove it's more effective than current solutions.

arxiv.org16 min read

04ENGINEERING & RESOURCES

DETECTION THROUGH REASONING

When detecting objects in a scene, you usually pull from a set of predefined classes. Also, asking questions about the scene is challenging. In this case, we can use powerful language models (Vicuna) with instruction tuned detectors to reason about queries and detect objects as a result.

github.comGitHub repository

OPEN-LLAMA

The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.

github.comGitHub repository

PALM

An open-source implementation of Google's PaLM models.

github.comGitHub repository

05MISCELLANEOUS

COHERE LLM UNIVERSITY

Cohere is a startup that offers a language model API similar to other big players. They have a set of powerful models that you can use to build applications. This language model university is designed to bring you up to speed on modern language models and show how to build on them with cohere's tools.

docs.cohere.com6 min read