TLDR AI · QUICK LINKS
VERIFY WEIGHTS DDP PYTORCH (GITHUB GIST)
Summary from the TLDR AI newsletter
Verifying training when sharding across devices can be challenging - this handy snippet verifies that things have been done and updated properly.
TLDR AI · QUICK LINKS
Verifying training when sharding across devices can be challenging - this handy snippet verifies that things have been done and updated properly.