vancouverisland.ctvnews.ca
robots.txt

Robots Exclusion Standard data for vancouverisland.ctvnews.ca

Resource Scan

Scan Details

Site Domain vancouverisland.ctvnews.ca
Base Domain ctvnews.ca
Scan Status Ok
Last Scan2025-04-02T12:46:19+00:00
Next Scan 2025-04-09T12:46:19+00:00

Last Scan

Scanned2025-04-02T12:46:19+00:00
URL https://vancouverisland.ctvnews.ca/robots.txt
Domain IPs 23.209.46.11, 23.209.46.15, 2600:1413:b000:14::b857:c145, 2600:1413:b000:14::b857:c14b
Response IP 42.99.140.192
Found Yes
Hash 6788ae8236698ab174e994d7111f7c46321266556c1730f3b752be63f6c5efb7
SimHash 6c24c812c777

Groups

*

Rule Path
Allow /
Disallow /404/test
Disallow /captcha/
Disallow /cmlink/
Disallow /cm/
Disallow /error/
Disallow /rss/
Disallow /redirect/
Disallow /status/
Disallow /errors/
Disallow /*%26cache%3D*
Disallow /mobile/
Disallow /*-1.*
Disallow /content/
Disallow /*.app$

googlebot-image

Rule Path
Allow /resizer/v2/

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.ctvnews.ca/arc/outboundfeeds/sitemap-index/
sitemap https://www.ctvnews.ca/arc/outboundfeeds/sitemap-news-index/
sitemap https://www.ctvnews.ca/arc/outboundfeeds/sitemap-video-index/
sitemap https://www.ctvnews.ca/shopping-sitemap.xml
sitemap https://www.ctvnews.ca/shopping-sitemap-section.xml