web.ics.purdue.edu
robots.txt

Robots Exclusion Standard data for web.ics.purdue.edu

Resource Scan

Scan Details

Site Domain web.ics.purdue.edu
Base Domain purdue.edu
Scan Status Ok
Last Scan2025-07-03T09:20:45+00:00
Next Scan 2025-08-02T09:20:45+00:00

Last Scan

Scanned2025-07-03T09:20:45+00:00
URL https://web.ics.purdue.edu/robots.txt
Domain IPs 128.210.13.35
Response IP 128.210.13.35
Found Yes
Hash fb9f2fcb5c1ae0aa9874e98e49bfdb05deca1d930eccc242a5cb66706a3d2c23
SimHash 4c12da21e383

Groups

googlebot
bingbot
applebot
duckduckbot
yandexbot
baiduspider
facebot
slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /