atlasandboots.com
robots.txt
Robots Exclusion Standard data for atlasandboots.com
Resource Scan
Scan Details
Site Domain | atlasandboots.com |
Base Domain | atlasandboots.com |
Scan Status | Ok |
Last Scan | 2024-11-13T05:35:00+00:00 |
Next Scan | 2024-11-20T05:35:00+00:00 |
Last Scan
Scanned | 2024-11-13T05:35:00+00:00 |
URL | https://atlasandboots.com/robots.txt |
Redirect | https://www.atlasandboots.com/robots.txt |
Redirect Domain | www.atlasandboots.com |
Redirect Base | atlasandboots.com |
Domain IPs | 217.70.184.55 |
Redirect IPs | 155.133.132.12, 2001:4b99:1:253::12 |
Response IP | 155.133.132.12 |
Found | Yes |
Hash | 7ac46a2b814379ad8c361af1cd13526958550f7777edbb74f441054765a36297 |
SimHash | 2808cc9067e1 |
Groups
*
Rule | Path |
---|---|
Allow | /*?v |
Disallow | /calendar/action* |
Disallow | /events/action* |
Disallow | /*? |
Disallow | /thank-you-ebook/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Comments