management.buffalo.edu
robots.txt

Robots Exclusion Standard data for management.buffalo.edu

Resource Scan

Scan Details

Site Domain management.buffalo.edu
Base Domain buffalo.edu
Scan Status Ok
Last Scan2024-11-03T10:07:48+00:00
Next Scan 2024-12-03T10:07:48+00:00

Last Scan

Scanned2024-11-03T10:07:48+00:00
URL https://management.buffalo.edu/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf, 96.17.96.20, 96.17.96.9
Response IP 23.44.5.80
Found Yes
Hash ed0b034b4a2c2400b543329243c15b4640b50920393250e907425bdeb27a4255
SimHash d9301328c5f3

Groups

*

Rule Path
Disallow /content/shared/
Disallow *CFC__target%3D*
Disallow *tag%3D*

twitterbot
facebookexternalhit
facebot

Rule Path
Allow /content/shared/*.img.