fightingrobots.co.uk
robots.txt
Robots Exclusion Standard data for fightingrobots.co.uk
Resource Scan
Scan Details
| Site Domain | fightingrobots.co.uk |
| Base Domain | fightingrobots.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-06-21T15:43:21+00:00 |
| Next Scan | 2025-07-21T15:43:21+00:00 |
Last Scan
| Scanned | 2025-06-21T15:43:21+00:00 |
| URL | https://fightingrobots.co.uk/robots.txt |
| Domain IPs | 217.160.0.77 |
| Response IP | 217.160.0.77 |
| Found | Yes |
| Hash | c9028797acec4a4396185e11eaefe960289668d5c2f5bdcb802fd7e5bf37b87c |
| SimHash | 2588636d4a86 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /go/ |
| Disallow | /cgi-bin/ |
| Disallow | /images/ |
| Disallow | /admincp/ |
| Disallow | /modcp/ |
| Disallow | /attachment.php |
| Disallow | /search.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /editpost.php |
| Disallow | /profile.php |
| Disallow | /register.php |
| Disallow | /login.php |
| Disallow | /subscription.php |
| Disallow | /private.php |
| Disallow | /report.php |
| Disallow | /sendmessage.php |
| Disallow | /member.php |
| Disallow | /memberlist.php |
| Disallow | /misc.php |
| Disallow | /moderator.php |
| Disallow | /postings.php |
| Disallow | /sendtofriend.php |
| Disallow | /threadrate.php |
| Disallow | /usercp.php |
| Disallow | /showgroups.php |
| Disallow | /announcement.php |