vancouverisland.ctvnews.ca
robots.txt
Robots Exclusion Standard data for vancouverisland.ctvnews.ca
Resource Scan
Scan Details
Site Domain | vancouverisland.ctvnews.ca |
Base Domain | ctvnews.ca |
Scan Status | Ok |
Last Scan | 2025-04-02T12:46:19+00:00 |
Next Scan | 2025-04-09T12:46:19+00:00 |
Last Scan
Scanned | 2025-04-02T12:46:19+00:00 |
URL | https://vancouverisland.ctvnews.ca/robots.txt |
Domain IPs | 23.209.46.11, 23.209.46.15, 2600:1413:b000:14::b857:c145, 2600:1413:b000:14::b857:c14b |
Response IP | 42.99.140.192 |
Found | Yes |
Hash | 6788ae8236698ab174e994d7111f7c46321266556c1730f3b752be63f6c5efb7 |
SimHash | 6c24c812c777 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /404/test |
Disallow | /captcha/ |
Disallow | /cmlink/ |
Disallow | /cm/ |
Disallow | /error/ |
Disallow | /rss/ |
Disallow | /redirect/ |
Disallow | /status/ |
Disallow | /errors/ |
Disallow | /*%26cache%3D* |
Disallow | /mobile/ |
Disallow | /*-1.* |
Disallow | /content/ |
Disallow | /*.app$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.ctvnews.ca/arc/outboundfeeds/sitemap-index/ |
sitemap | https://www.ctvnews.ca/arc/outboundfeeds/sitemap-news-index/ |
sitemap | https://www.ctvnews.ca/arc/outboundfeeds/sitemap-video-index/ |
sitemap | https://www.ctvnews.ca/shopping-sitemap.xml |
sitemap | https://www.ctvnews.ca/shopping-sitemap-section.xml |