deubaxxl.co.uk
robots.txt
Robots Exclusion Standard data for deubaxxl.co.uk
Resource Scan
Scan Details
| Site Domain | deubaxxl.co.uk |
| Base Domain | deubaxxl.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-11-20T23:07:08+00:00 |
| Next Scan | 2025-12-20T23:07:08+00:00 |
Last Scan
| Scanned | 2025-11-20T23:07:08+00:00 |
| URL | https://deubaxxl.co.uk/robots.txt |
| Redirect | https://www.deubaxxl.co.uk/robots.txt |
| Redirect Domain | www.deubaxxl.co.uk |
| Redirect Base | deubaxxl.co.uk |
| Domain IPs | 104.21.56.5, 172.67.175.31, 2606:4700:3031::6815:3805, 2606:4700:3033::ac43:af1f |
| Redirect IPs | 104.21.56.5, 172.67.175.31, 2606:4700:3031::6815:3805, 2606:4700:3033::ac43:af1f |
| Response IP | 104.21.56.5 |
| Found | Yes |
| Hash | 38a951e24a87b30c795cf0c5048d8d586cecf28e06ba64fbac9dc6ec47d27651 |
| SimHash | eb081ed1faf9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /awin/ |
| Disallow | /awin/htlp.html |
| Disallow | /*?*filter=* |
| Disallow | /*?*query=* |
| Disallow | /compare/ |
| Disallow | /note/ |
| Disallow | /ticket/ |
| Disallow | /tracking/ |
| Disallow | /wishlist/ |
| Disallow | /*account/ |
| Disallow | /*checkout/ |
| Disallow | /*navigation/ |
| Disallow | /register/ |
| Disallow | /address/ |
| Allow | /thumbnail/ |
| Allow | /media/ |
| Allow | /bundles/ |
| Allow | /*/loader.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.deubaxxl.co.uk/sitemap.xml |