kitchener.ctvnews.ca
robots.txt

Robots Exclusion Standard data for kitchener.ctvnews.ca

Resource Scan

Scan Details

Site Domain kitchener.ctvnews.ca
Base Domain ctvnews.ca
Scan Status Ok
Last Scan2024-05-25T19:13:02+00:00
Next Scan 2024-06-24T19:13:02+00:00

Last Scan

Scanned2024-05-25T19:13:02+00:00
URL https://kitchener.ctvnews.ca/robots.txt
Domain IPs 125.252.229.238
Response IP 23.15.101.121
Found Yes
Hash c703487e27076642494331e6eb18cab57326791ecd8e7160484ecf96f4c6f735
SimHash ca348d1801d7

Groups

*

Rule Path
Allow /
Disallow /search-results/
Disallow /poll/
Disallow /logger/
Disallow /cmlink/
Disallow /cm/
Disallow /error/
Disallow /errorpages/
Disallow /captcha/
Disallow /hot-topics/
Disallow /membership/
Disallow /blogimageupload/
Disallow /polopolydevelopment/
Disallow /status/
Disallow /redirect/
Disallow /crossdomain.xml
Disallow /flagcomment/
Disallow /*stubReferenceName
Disallow /comments-7.*

googlebot-image

Rule Path
Allow /content/dam/

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://kitchener.ctvnews.ca/sitemap.xml
sitemap https://kitchener.ctvnews.ca/sitemap_news.xml
sitemap https://kitchener.ctvnews.ca/sitemap_mobile.xml