robin-wood.co.uk
robots.txt
Robots Exclusion Standard data for robin-wood.co.uk
Resource Scan
Scan Details
| Site Domain | robin-wood.co.uk |
| Base Domain | robin-wood.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-10-12T13:50:30+00:00 |
| Next Scan | 2025-11-11T13:50:30+00:00 |
Last Scan
| Scanned | 2025-10-12T13:50:30+00:00 |
| URL | https://robin-wood.co.uk/robots.txt |
| Domain IPs | 185.194.90.10 |
| Response IP | 185.194.90.10 |
| Found | Yes |
| Hash | decc4dda55019e5d6cb17b8f14d7bda853110694e533fb5874b56cefaa024e4a |
| SimHash | f8315d2a4eb0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*add-to-cart%3D* |
| Disallow | /wp-admin/ |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /blackhole/ |
| Disallow | /mint/ |
| Disallow | /feed/ |
| Allow | /tag/mint/ |
| Allow | /tag/feed/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |