AMAZONBOT NOW RESPECTS ROBOTS.TXT RULES

Amazon's web crawler has begun honoring robots.txt directives, the standard protocol websites use to control bot access. The change addresses long-standing concerns about Amazonbot's compliance with these restrictions.