quebec.shopbot.ca
robots.txt

Robots Exclusion Standard data for quebec.shopbot.ca

Resource Scan

Scan Details

Site Domain quebec.shopbot.ca
Base Domain shopbot.ca
Scan Status Ok
Last Scan2025-12-11T22:08:03+00:00
Next Scan 2026-01-10T22:08:03+00:00

Last Scan

Scanned2025-12-11T22:08:03+00:00
URL https://quebec.shopbot.ca/robots.txt
Redirect https://www.shopbot.ca/robots.txt
Redirect Domain www.shopbot.ca
Redirect Base shopbot.ca
Domain IPs 104.26.12.237, 104.26.13.237, 172.67.72.127, 2606:4700:20::681a:ced, 2606:4700:20::681a:ded, 2606:4700:20::ac43:487f
Redirect IPs 104.26.12.237, 104.26.13.237, 172.67.72.127, 2606:4700:20::681a:ced, 2606:4700:20::681a:ded, 2606:4700:20::ac43:487f
Response IP 104.26.13.237
Found Yes
Hash d3b3a2121d25f1db2d802cb07fd524fc64f45829169f812e9c6f7038a6e5afe8
SimHash 6615c4828183

Groups

*

Rule Path
Disallow /categories.php
Disallow /brands.php
Disallow /reviews.php
Disallow /privacy.php
Disallow /brand/
Disallow /tos.php
Disallow /admin/
Disallow /search.php
Disallow /jump.php
Disallow /imageCache.php
Disallow /create_xml.php
Disallow /old_sitemap.php
Disallow /review/*
Disallow /product/*
Disallow webmail.shopbot.ca/*

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.shopbot.ca/sitemap.xml
sitemap https://www.shopbot.ca/reviews/sitemap_index.xml