barrhavenwellnesscentre.com
robots.txt
Robots Exclusion Standard data for barrhavenwellnesscentre.com
Resource Scan
Scan Details
Site Domain | barrhavenwellnesscentre.com |
Base Domain | barrhavenwellnesscentre.com |
Scan Status | Ok |
Last Scan | 2024-11-15T20:12:26+00:00 |
Next Scan | 2024-11-29T20:12:26+00:00 |
Last Scan
Scanned | 2024-11-15T20:12:26+00:00 |
URL | https://barrhavenwellnesscentre.com/robots.txt |
Redirect | https://www.barrhavenwellnesscentre.com/robots.txt |
Redirect Domain | www.barrhavenwellnesscentre.com |
Redirect Base | barrhavenwellnesscentre.com |
Domain IPs | 13.33.88.100, 13.33.88.103, 13.33.88.36, 13.33.88.46 |
Redirect IPs | 13.33.88.100, 13.33.88.103, 13.33.88.36, 13.33.88.46 |
Response IP | 13.33.88.36 |
Found | Yes |
Hash | db770dc6d2ce67471c5ea1edc51fb0e70441d6e38a48d5c80bec9030efa95703 |
SimHash | 70099c60a388 |
Groups
*
Rule | Path |
---|---|
Disallow | /dash/ |
Disallow | /pp* |
Disallow | /trackback |
Disallow | /cgi-bin |
Disallow | /search |
Disallow | /rss |
Disallow | /comments/feed |
Disallow | /*/trackback/$ |
Disallow | /hero_slides |
Disallow | /banners |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.barrhavenwellnesscentre.com/sitemap.xml |