comparaboo.co.uk
robots.txt
Robots Exclusion Standard data for comparaboo.co.uk
Resource Scan
Scan Details
| Site Domain | comparaboo.co.uk |
| Base Domain | comparaboo.co.uk |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-09-29T22:35:35+00:00 |
| Next Scan | 2025-12-28T22:35:35+00:00 |
Last Successful Scan
| Scanned | 2023-12-10T14:37:53+00:00 |
| URL | https://comparaboo.co.uk/robots.txt |
| Redirect | https://www.comparaboo.co.uk/robots.txt |
| Redirect Domain | www.comparaboo.co.uk |
| Redirect Base | comparaboo.co.uk |
| Domain IPs | 104.21.72.65, 172.67.176.14, 2606:4700:3031::ac43:b00e, 2606:4700:3032::6815:4841 |
| Redirect IPs | 104.21.72.65, 172.67.176.14, 2606:4700:3031::ac43:b00e, 2606:4700:3032::6815:4841 |
| Response IP | 104.21.72.65 |
| Found | Yes |
| Hash | c2a6dbb24dda6457e7475bb2ffbf626bbca60fb8a3505f99ef0e4510af0ffc4e |
| SimHash | 690906414f12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redirect |
| Disallow | /nolayout |
| Disallow | /amp/p/ |
| Disallow | /amp/lists/ |
| Disallow | /p/ |
| Disallow | /products/ |
| Disallow | amp/widget/ |
| Disallow | /blog/ |
| Disallow | /search_results/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.comparaboo.co.uk/sitemap.xml |