engineering.buffalo.edu
robots.txt

Robots Exclusion Standard data for engineering.buffalo.edu

Resource Scan

Scan Details

Site Domain engineering.buffalo.edu
Base Domain buffalo.edu
Scan Status Ok
Last Scan2024-11-06T13:07:00+00:00
Next Scan 2024-12-06T13:07:00+00:00

Last Scan

Scanned2024-11-06T13:07:00+00:00
URL https://engineering.buffalo.edu/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf, 96.17.96.20, 96.17.96.9
Response IP 23.52.40.152
Found Yes
Hash b9d9e4ca7030a65760f94e566730c09ed02ad46783e92deedd4be42b6fe8cff9
SimHash f920d008c5fb

Groups

*

Rule Path
Disallow /content/shared/
Disallow *CFC__target%3D
Disallow *tag%3D

twitterbot
facebookexternalhit
facebot

Rule Path
Allow /content/shared/*.img.