amway.com
robots.txt
Robots Exclusion Standard data for amway.com
Resource Scan
Scan Details
Site Domain | amway.com |
Base Domain | amway.com |
Scan Status | Ok |
Last Scan | 2024-06-23T19:29:01+00:00 |
Next Scan | 2024-07-23T19:29:01+00:00 |
Last Scan
Scanned | 2024-06-23T19:29:01+00:00 |
URL | https://amway.com/robots.txt |
Redirect | https://www.amway.com/robots.txt |
Redirect Domain | www.amway.com |
Redirect Base | amway.com |
Domain IPs | 13.33.88.22, 13.33.88.33, 13.33.88.52, 13.33.88.86 |
Redirect IPs | 13.33.88.22, 13.33.88.33, 13.33.88.52, 13.33.88.86 |
Response IP | 13.33.88.86 |
Found | Yes |
Hash | 397c92276662ac696527e30aeb2dcc20b23a94bb5044fe91555204ea4bbd52eb |
SimHash | ec50df9cefe2 |
Groups
*
Rule | Path |
---|---|
Disallow | /en_US/cart |
Disallow | /en_US/checkout |
Disallow | /en_US/my-account |
Disallow | /en_US/myshop |
Disallow | /en_US/share-link |
Disallow | /en_US/components/header |
Disallow | /en_US/components/footer |
Disallow | /en_US/*/calculator |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | 10 seconds between page requests |
Other Records
Field | Value |
---|---|
sitemap | https://www.amway.com/en_US/sitemap.xml |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments