cicfriend.cic.unb.br
robots.txt
Robots Exclusion Standard data for cicfriend.cic.unb.br
Resource Scan
Scan Details
| Site Domain | cicfriend.cic.unb.br |
| Base Domain | unb.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2024-07-25T18:00:40+00:00 |
| Next Scan | 2024-10-23T18:00:40+00:00 |
Last Successful Scan
| Scanned | 2023-10-06T17:18:21+00:00 |
| URL | https://cicfriend.cic.unb.br/robots.txt |
| Domain IPs | 164.41.76.36 |
| Response IP | 164.41.76.36 |
| Found | Yes |
| Hash | 8eab7b5220a019a2f822e62533d58bf72c3ec6161643264a72172883ae08969f |
| SimHash | e535a81ec3d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /settings/ |
| Disallow | /admin/ |
| Disallow | /message/ |
| Disallow | /search |
| Disallow | /help |
| Disallow | /proxy |