TLDR AI · ENGINEERING & RESOURCES
3B PARAMETER TOKENIZER
Summary from the TLDR AI newsletter
Scaling up image tokenizers is challenging because they tend to collapse. This work introduces GigaTok, which is a massive tokenizer with superior reconstruction performance. Decoder scaling and regularization helped with stability and overall quality.