TLDR AI · ENGINEERING & RESOURCES

LIGHTWEIGHT FAST INFERENCE ENGINE FOR HUGGINGFACE DIFFUSERS

github.comGitHub repository

Summary from the TLDR AI newsletter

Lots of small improvements have added up to substantial speed improvements (claimed 60 steps per second up from 23).