AMAZONBOT IS FINALLY RESPECTING ROBOTS.TXT

Summary from the TLDR Dev newsletter

Starting June 15, Amazonbot will officially transition to respecting industry-standard robots.txt directives, granting website owners direct control over how the crawler accesses their sites.