PAINTING WITH CONCEPTS USING DIFFUSION MODEL LATENTS

Summary from the TLDR AI newsletter

Goodfire's Paint With Ember is a tool that lets users directly manipulate the neural activations of image models by painting simple pixel images instead of using text prompts. The tool uses sparse autoencoders to decode Stable Diffusion XL-Turbo's internal features into interpretable visual concepts, allowing direct access to the model's "brain."