hamilton.edu
robots.txt

Robots Exclusion Standard data for hamilton.edu

Resource Scan

Scan Details

Site Domain hamilton.edu
Base Domain hamilton.edu
Scan Status Ok
Last Scan2024-06-30T06:35:13+00:00
Next Scan 2024-07-30T06:35:13+00:00

Last Scan

Scanned2024-06-30T06:35:13+00:00
URL https://hamilton.edu/robots.txt
Redirect https://www.hamilton.edu/robots.txt
Redirect Domain www.hamilton.edu
Redirect Base hamilton.edu
Domain IPs 150.209.10.119
Redirect IPs 150.209.10.119
Response IP 150.209.10.119
Found Yes
Hash 0b35457a0c13cac83a3c766b50405fda66d7aff30bbac70581c7ea448e9b4027
SimHash 2a4157a5cb1a

Groups

*

Rule Path
Disallow /print.cfm
Disallow /performingarts/performing-arts-reservations
Disallow /applications/test
Disallow /applications/vanschedule
Disallow /lab-reservations
Disallow /applications/calendar/index.cfm
Disallow /news/email
Disallow /uniobjerror.cfm
Disallow *?print=yes
Disallow *daterequest%3D
Disallow /applications/catalogue/syllabi/
Disallow /myhamilton/alumni/listing.html
Disallow /applications/scheduledtasks/

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

blp_bbot/0.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hamilton.edu/sitemap.xml

Comments

  • robots.txt for https://www.hamilton.edu/