amway.com.do
robots.txt
Robots Exclusion Standard data for amway.com.do
Resource Scan
Scan Details
Site Domain | amway.com.do |
Base Domain | amway.com.do |
Scan Status | Ok |
Last Scan | 2024-09-24T12:48:35+00:00 |
Next Scan | 2024-10-01T12:48:35+00:00 |
Last Scan
Scanned | 2024-09-24T12:48:35+00:00 |
URL | https://amway.com.do/robots.txt |
Redirect | https://www.amway.com.do/robots.txt |
Redirect Domain | www.amway.com.do |
Redirect Base | amway.com.do |
Domain IPs | 23.5.165.176, 23.5.165.179 |
Redirect IPs | 108.157.254.124, 108.157.254.26, 108.157.254.35, 108.157.254.96 |
Response IP | 108.157.254.96 |
Found | Yes |
Hash | de1180a090108e42b549fb3e2eaab41f6f883dcaed28ffad1622201167fd78a8 |
SimHash | 6a405fddedf0 |
Groups
*
Rule | Path |
---|---|
Disallow | /es_DO/cart |
Disallow | /es_DO/checkout |
Disallow | /es_DO/my-account |
Disallow | /es_DO/myshop |
Disallow | /es_DO/share-link |
Disallow | /es_DO/components/header |
Disallow | /es_DO/components/footer |
Disallow | /es_DO/*/calculator |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | 10 seconds between page requests |
Other Records
Field | Value |
---|---|
sitemap | https://www.amway.com.do/es_DO/sitemap.xml |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments