bayfm.ca
robots.txt
Robots Exclusion Standard data for bayfm.ca
Resource Scan
Scan Details
Site Domain | bayfm.ca |
Base Domain | bayfm.ca |
Scan Status | Ok |
Last Scan | 2024-11-14T15:22:46+00:00 |
Next Scan | 2024-11-21T15:22:46+00:00 |
Last Scan
Scanned | 2024-11-14T15:22:46+00:00 |
URL | https://bayfm.ca/robots.txt |
Redirect | https://www.bayfm.ca/robots.txt |
Redirect Domain | www.bayfm.ca |
Redirect Base | bayfm.ca |
Domain IPs | 34.250.153.99 |
Redirect IPs | 52.222.144.12, 52.222.144.24, 52.222.144.31, 52.222.144.64 |
Response IP | 65.9.112.57 |
Found | Yes |
Hash | 51ad5bb14ca7e431269ae3e52c1d0ce0360e1e1b54b2372ad806d8df194bd53d |
SimHash | 69305c34cdd5 |
Groups
*
Rule | Path |
---|---|
Disallow | /_hp/ |
Disallow | /artist/ |
Disallow | /searchresults/ |
Other Records
Field | Value |
---|---|
crawl-delay | 8 |
Other Records
Field | Value |
---|---|
sitemap | https://www.bayfm.ca/sitemap.xml |