cse.unl.edu
robots.txt
Robots Exclusion Standard data for cse.unl.edu
Resource Scan
Scan Details
Site Domain | cse.unl.edu |
Base Domain | unl.edu |
Scan Status | Ok |
Last Scan | 2024-09-09T14:18:53+00:00 |
Next Scan | 2024-10-09T14:18:53+00:00 |
Last Scan
Scanned | 2024-09-09T14:18:53+00:00 |
URL | https://cse.unl.edu/robots.txt |
Domain IPs | 129.93.1.30 |
Response IP | 129.93.1.30 |
Found | Yes |
Hash | c3f969719a688b841c9adcdfd68199126db115908fecae6b1dcd7c3ce14749aa |
SimHash | e844bd99a7f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /htdocs.old |
Disallow | /BACKUP |
Disallow | /Templates |
Disallow | /2del |
Comments