engineering.buffalo.edu
robots.txt
Robots Exclusion Standard data for engineering.buffalo.edu
Resource Scan
Scan Details
Site Domain | engineering.buffalo.edu |
Base Domain | buffalo.edu |
Scan Status | Ok |
Last Scan | 2024-11-06T13:07:00+00:00 |
Next Scan | 2024-12-06T13:07:00+00:00 |
Last Scan
Scanned | 2024-11-06T13:07:00+00:00 |
URL | https://engineering.buffalo.edu/robots.txt |
Domain IPs | 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf, 96.17.96.20, 96.17.96.9 |
Response IP | 23.52.40.152 |
Found | Yes |
Hash | b9d9e4ca7030a65760f94e566730c09ed02ad46783e92deedd4be42b6fe8cff9 |
SimHash | f920d008c5fb |
Groups
*
Rule | Path |
---|---|
Disallow | /content/shared/ |
Disallow | *CFC__target%3D |
Disallow | *tag%3D |