Log In Sign Up

courses.opened.uoguelph.ca
robots.txt

Robots Exclusion Standard data for courses.opened.uoguelph.ca

Resource Scan

Scan Details

Site Domain courses.opened.uoguelph.ca
Base Domain uoguelph.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-23T18:51:55+00:00
Next Scan 2025-03-25T18:51:55+00:00

Last Successful Scan

Scanned2025-01-02T17:33:59+00:00
URL https://courses.opened.uoguelph.ca/robots.txt
Domain IPs 18.66.196.125, 18.66.196.14, 18.66.196.71, 18.66.196.75
Response IP 13.226.2.100
Found Yes
Hash 3b4998d751805001f41e03d362ae151d48adb2a4942223e7bdea2e8b76ab6dbf
SimHash 2a01dd42a391

Groups

*

Rule Path
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38023053
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38023304
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38203285
Disallow /search/publicCourseSearchDetails.do%3Bjsessionid%3DE0381E57B6100ECB887F11E513A518B5?method=load&courseId=38203287
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=27097750
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=27343005
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28158747
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28221918
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=28222215
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=32823592
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=33000786
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=33314912
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=37333927
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=37333929
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38713742
Disallow /search/publicCourseSearchDetails.do?method=load&courseId=38450876

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Set the delay for all crawlers to 10 seconds
Back to top

Warnings

  • `https` is not a known field.
Back to top