TLDR Index
Daily Editions
Contents
  1. Page 1: Today’s IndexTLDR, TLDR AI, TLDR InfoSec, TLDR Crypto, TLDR Product · 9 stories
  2. Page 2: TLDRTLDR · 10 stories
  3. Page 3: TLDR AITLDR AI · 11 stories
  4. Page 4: TLDR InfoSecTLDR InfoSec · 11 stories
  5. Page 5: TLDR CryptoTLDR Crypto · 12 stories
  6. Page 6: TLDR ProductTLDR Product · 9 stories
  7. Page 7: TLDR DesignTLDR Design · 12 stories
  8. Page 8: TLDR MarketingTLDR Marketing · 11 stories
  9. Page 9: Resources & ToolsTLDR AI, TLDR InfoSec, TLDR Design, TLDR Marketing · 9 stories
  10. Page 10: SponsoredTLDR, TLDR AI, TLDR Product, TLDR Marketing · 6 stories
?
Keyboard shortcuts
← / →
Previous / next page
↑ / ↓
Scroll while full screen
PgUp / PgDn
Scroll by viewport
Space
Scroll down by viewport
Shift+Space
Scroll up by viewport
Home
First page
End
Last page
F
Full screen
Escape
Exit immersive mode

Daily Edition · Page 9

THE DAILY INDEX

Technology, AI, software, security, crypto and business

Repositories, courses and useful tools

Resources & Tools

TLDR AI · GitHub repository

QUEST: STABLE TRAINING OF LLMS WITH 1-BIT WEIGHTS AND ACTIVATIONS

QuEST allows stable training with 1-bit weights and activations. QuEST achieves this by improving two key aspects of QAT methods: accurate and fast quantization of the (continuous) distributions of weights and activations via Hadamard normalization and MSE-optimal fitting, and a new trust gradient estimator based on the idea of explicitly minimizing the error between the noisy gradient computed over quantized states and the "true" (but unknown) full-precision gradient.

github.com

TLDR IndexPage 9