gograysharbor.com
robots.txt
Robots Exclusion Standard data for gograysharbor.com
Resource Scan
Scan Details
Site Domain | gograysharbor.com |
Base Domain | gograysharbor.com |
Scan Status | Ok |
Last Scan | 2024-10-28T22:48:33+00:00 |
Next Scan | 2024-11-04T22:48:33+00:00 |
Last Scan
Scanned | 2024-10-28T22:48:33+00:00 |
URL | https://gograysharbor.com/robots.txt |
Redirect | https://www.gograysharbor.com/robots.txt |
Redirect Domain | www.gograysharbor.com |
Redirect Base | gograysharbor.com |
Domain IPs | 34.250.153.99 |
Redirect IPs | 216.137.52.13, 216.137.52.6, 216.137.52.72, 216.137.52.90 |
Response IP | 3.164.206.62 |
Found | Yes |
Hash | fad9c8e8dfdefe231df0474a0b41f24703ec25f3ae7a199a407d7bf2dd6fa125 |
SimHash | 29205cd6ceb6 |
Groups
*
Rule | Path |
---|---|
Disallow | /_hp/ |
Disallow | /on-air/artist/ |
Disallow | /jack-fm/on-air/artist/ |
Disallow | /bigfoot-country/on-air/artist/ |
Disallow | /sunny/on-air/artist/ |
Disallow | /timber-country/on-air/artist/ |
Disallow | /y1073/on-air/artist/ |
Disallow | /searchresults/ |
Other Records
Field | Value |
---|---|
crawl-delay | 8 |
Other Records
Field | Value |
---|---|
sitemap | https://www.gograysharbor.com/sitemap.xml |