dalonline.dal.ca
robots.txt

Robots Exclusion Standard data for dalonline.dal.ca

Resource Scan

Scan Details

Site Domain dalonline.dal.ca
Base Domain dal.ca
Scan Status Ok
Last Scan2024-11-03T07:48:18+00:00
Next Scan 2024-12-03T07:48:18+00:00

Last Scan

Scanned2024-11-03T07:48:18+00:00
URL https://dalonline.dal.ca/robots.txt
Domain IPs 129.173.80.4
Response IP 129.173.80.4
Found Yes
Hash f03067e3b2a9d470ef7f29f087cacedc6c2c96a97f0f07c149ec3539866c304b
SimHash 6118d8e2c315

Groups

*

Rule Path
Disallow /

gsa-crawler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30