pilatesanytime.com
robots.txt
Robots Exclusion Standard data for pilatesanytime.com
Resource Scan
Scan Details
Site Domain | pilatesanytime.com |
Base Domain | pilatesanytime.com |
Scan Status | Ok |
Last Scan | 2024-11-15T07:39:24+00:00 |
Next Scan | 2024-11-29T07:39:24+00:00 |
Last Scan
Scanned | 2024-11-15T07:39:24+00:00 |
URL | https://pilatesanytime.com/robots.txt |
Redirect | https://www.pilatesanytime.com:443/robots.txt |
Redirect Domain | www.pilatesanytime.com |
Redirect Base | pilatesanytime.com |
Domain IPs | 50.18.194.201, 54.176.131.249 |
Redirect IPs | 52.8.64.78, 54.177.104.11 |
Response IP | 52.8.64.78 |
Found | Yes |
Hash | f9f6abcc13d08280585fa1857ea3ec74d1e4a8b51fad385d7edcfa6eb4fd324f |
SimHash | b15d4cf2f29b |
Groups
*
Rule | Path |
---|---|
Disallow | /errors/ |
Disallow | /m/ |
Disallow | /ads/ |
Disallow | /cloudfront/ |
Disallow | /paypal/ |
Disallow | /swf/ |
Disallow | /videos/ |
Disallow | /roku/ |
Disallow | /roku_xml/ |
Disallow | /tasks/ |
Disallow | */audio/ |
Disallow | /next/ |
Disallow | /functions/ |
Disallow | /webhooks/ |
Disallow | /set_currency.cfm |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |