history.alberta.ca
robots.txt

Robots Exclusion Standard data for history.alberta.ca

Resource Scan

Scan Details

Site Domain history.alberta.ca
Base Domain alberta.ca
Scan Status Ok
Last Scan2025-12-07T11:42:40+00:00
Next Scan 2026-01-06T11:42:40+00:00

Last Scan

Scanned2025-12-07T11:42:40+00:00
URL https://history.alberta.ca/robots.txt
Domain IPs 104.18.6.162, 104.18.7.162, 2606:4700::6812:6a2, 2606:4700::6812:7a2
Response IP 104.18.7.162
Found Yes
Hash 3a8945e5d6bf973d8e6d22589d9a6641e9fe9252499bf03eb3caf6872ec4155a
SimHash 940553046552

Groups

scrapy

Rule Path
Disallow /energyheritage/
Disallow /EnergyHeritage/