readingcomputerrecycling.co.uk
robots.txt
Robots Exclusion Standard data for readingcomputerrecycling.co.uk
Resource Scan
Scan Details
| Site Domain | readingcomputerrecycling.co.uk |
| Base Domain | readingcomputerrecycling.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-04-09T10:15:32+00:00 |
| Next Scan | 2025-05-09T10:15:32+00:00 |
Last Scan
| Scanned | 2025-04-09T10:15:32+00:00 |
| URL | https://readingcomputerrecycling.co.uk/robots.txt |
| Domain IPs | 104.21.18.70, 172.67.180.199, 2606:4700:3033::6815:1246, 2606:4700:3033::ac43:b4c7 |
| Response IP | 104.21.18.70 |
| Found | Yes |
| Hash | 0c02a8ff8e9f3378f79f2482abc6c8e147d5cf6a59cfead1d9286b296cda46b4 |
| SimHash | 424944502f11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Allow | /wp-includes/js/ |
| Allow | /wp-content/plugins/ |
| Allow | /wp-content/themes/ |
| Allow | /wp-content/cache/ |
| Disallow | /xmlrpc.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://readingcomputerrecycling.co.uk/sitemap_index.xml |
Comments