cancerchat.cancerresearchuk.org
robots.txt
Robots Exclusion Standard data for cancerchat.cancerresearchuk.org
Resource Scan
Scan Details
| Site Domain | cancerchat.cancerresearchuk.org |
| Base Domain | cancerresearchuk.org |
| Scan Status | Ok |
| Last Scan | 2024-11-03T09:48:28+00:00 |
| Next Scan | 2024-12-03T09:48:28+00:00 |
Last Scan
| Scanned | 2024-11-03T09:48:28+00:00 |
| URL | https://cancerchat.cancerresearchuk.org/robots.txt |
| Domain IPs | 108.157.254.10, 108.157.254.40, 108.157.254.83, 108.157.254.94, 2600:9000:2753:4400:17:fbd6:cb40:93a1, 2600:9000:2753:6600:17:fbd6:cb40:93a1, 2600:9000:2753:8600:17:fbd6:cb40:93a1, 2600:9000:2753:8800:17:fbd6:cb40:93a1, 2600:9000:2753:9000:17:fbd6:cb40:93a1, 2600:9000:2753:ac00:17:fbd6:cb40:93a1, 2600:9000:2753:ca00:17:fbd6:cb40:93a1, 2600:9000:2753:d000:17:fbd6:cb40:93a1 |
| Response IP | 108.157.254.10 |
| Found | Yes |
| Hash | 8466bcd98afa22be02de5757dd31981eb587ab8747c836d3075741ec5f10d966 |
| SimHash | ab5d9d54efda |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /utility/ |
| Disallow | /error |
| Disallow | /search |
| Disallow | /msgs |
| Disallow | /api.ashx |
| Disallow | /tags |
| Disallow | /*/tags |
| Disallow | *.axd |