Log In Sign Up

schoolsrc.ca
robots.txt

Robots Exclusion Standard data for schoolsrc.ca

Resource Scan

Scan Details

Site Domain schoolsrc.ca
Base Domain schoolsrc.ca
Scan Status Ok
Last Scan2025-06-14T23:46:35+00:00
Next Scan 2025-07-14T23:46:35+00:00

Last Scan

Scanned2025-06-14T23:46:35+00:00
URL https://schoolsrc.ca/robots.txt
Domain IPs 104.21.0.221, 172.67.128.85, 2606:4700:3036::6815:dd, 2606:4700:3036::ac43:8055
Response IP 172.67.128.85
Found Yes
Hash edd57047c3dfecdb0067496a38f589e4742421c92415ac1a8d63687eaeddaf35
SimHash 221ac170c0b5

Groups

msnbot
friendlycrawler
bytespider
amazonbot

Rule Path
Disallow /user/
Disallow /product/list/*

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /user/
Disallow /order/show
Disallow /product/list/*

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

yacybot

Rule Path
Disallow /
Back to top