deubaxxl.it
robots.txt
Robots Exclusion Standard data for deubaxxl.it
Resource Scan
Scan Details
| Site Domain | deubaxxl.it |
| Base Domain | deubaxxl.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-11T18:07:15+00:00 |
| Next Scan | 2026-01-09T18:07:15+00:00 |
Last Successful Scan
| Scanned | 2025-05-22T13:34:21+00:00 |
| URL | https://deubaxxl.it/robots.txt |
| Redirect | https://www.deubaxxl.it/robots.txt |
| Redirect Domain | www.deubaxxl.it |
| Redirect Base | deubaxxl.it |
| Domain IPs | 116.202.199.129, 5.9.34.36 |
| Redirect IPs | 116.202.199.129, 5.9.34.36 |
| Response IP | 116.202.199.129 |
| Found | Yes |
| Hash | 44e60d579c2c58fff1ec2497f819f0dfb3ee01fd576590af5907a991366ee2dd |
| SimHash | e9081ee3faf9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /awin/ |
| Disallow | /awin/htlp.html |
| Disallow | /*?*filter=* |
| Disallow | /*?*query=* |
| Disallow | /compare/ |
| Disallow | /note/ |
| Disallow | /ticket/ |
| Disallow | /tracking/ |
| Disallow | /wishlist/ |
| Disallow | /*account/ |
| Disallow | /*checkout/ |
| Disallow | /*navigation/ |
| Disallow | /register/ |
| Disallow | /address/ |
| Allow | /thumbnail/ |
| Allow | /media/ |
| Allow | /bundles/ |
| Allow | /*/loader.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.deubaxxl.it/sitemap.xml |