TLDR Index
TLDR AI

TLDR AI 2023-03-02

5 sections12 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

02RESEARCH & INNOVATION

GENERATION

Text-conditional diffusion models can generate high-quality images, but they often require additional controls to ensure precise image output. In this paper, the authors introduce Collage Diffusion, a collage-conditional diffusion algorithm that allows users to control the spatial arrangement and visual attributes of objects in the scene. By defining a collage with an ordered sequence of layers, each with an RGBA image and corresponding text prompt, users can control image harmonization on a layer-by-layer basis and edit individual objects in generated images while keeping other objects fixed. Collage Diffusion modifies text-image cross-attention with alpha masks to ensure different parts of the input text correspond to the various locations specified in the input collage layers. This approach generates globally harmonized images that maintain desired object locations and visual characteristics better than prior approaches.

arxiv.org13 min read

03ENGINEERING & RESOURCES

RLHF TO REDUCE LANGUAGE MODEL TOXICITY

Aligning language models is hard. One method uses “Human Feedback” to train a reward model. However, if we can compute the reward model on the fly from each example, there is no need for expensive feedback. In this example, they use another language model to score the toxicity of a piece of text. They can use that as a reward to decrease the toxicity of a model’s output.

huggingface.co6 min read

INDIRECT PROMPT INJECTION ON BING CHAT

If allowed by the user, Bing Chat can see currently open websites. The authors show that an attacker can plant an injection in a website the user is visiting, which silently turns Bing Chat into a Social Engineer who seeks out and infiltrates personal information. The user doesn't have to ask about the website or do anything except interact with Bing Chat while the website is opened in the browser.

greshake.github.io15 min read

04MISCELLANEOUS