courses.scs.uoguelph.ca
robots.txt

Robots Exclusion Standard data for courses.scs.uoguelph.ca

Resource Scan

Scan Details

Site Domain courses.scs.uoguelph.ca
Base Domain uoguelph.ca
Scan Status Ok
Last Scan2025-08-08T17:34:08+00:00
Next Scan 2025-09-07T17:34:08+00:00

Last Scan

Scanned2025-08-08T17:34:08+00:00
URL https://courses.scs.uoguelph.ca/robots.txt
Domain IPs 13.226.2.100, 13.226.2.24, 13.226.2.71, 13.226.2.76
Response IP 18.244.87.80
Found Yes
Hash 3b4998d751805001f41e03d362ae151d48adb2a4942223e7bdea2e8b76ab6dbf
SimHash 2a01dd42a391

Groups

*

Rule Path
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38023053
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38023304
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38203285
Disallow /search/publicCourseSearchDetails.do%3Bjsessionid%3DE0381E57B6100ECB887F11E513A518B5?method=load&courseId=38203287
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=27097750
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=27343005
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28158747
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28221918
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28222215
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=32823592
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=33000786
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=33314912
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=37333927
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=37333929
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38713742
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38450876

Other Records

Field Value
crawl-delay 10

Comments

  • Set the delay for all crawlers to 10 seconds

Warnings

  • `https` is not a known field.