dawsoncreekdailynews.ca
robots.txt

Robots Exclusion Standard data for dawsoncreekdailynews.ca

Resource Scan

Scan Details

Site Domain dawsoncreekdailynews.ca
Base Domain dawsoncreekdailynews.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-21T01:27:49+00:00
Next Scan 2024-06-20T01:27:49+00:00

Last Successful Scan

Scanned2024-03-29T22:32:39+00:00
URL http://dawsoncreekdailynews.ca/robots.txt
Redirect https://www.princegeorgecitizen.com/robots.txt
Redirect Domain www.princegeorgecitizen.com
Redirect Base princegeorgecitizen.com
Domain IPs 209.15.37.6
Redirect IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash b240b47c0c5c74c64961628aa2475377ca50bc326c0843c39586f8ad48e50c0f
SimHash 4904cba0e510

Groups

*

Rule Path
Allow /

googlebot-news

Rule Path
Allow /rss/showcase

googlebot

Rule Path
Allow /rss/showcase

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /