cleatsshop.com
robots.txt
Robots Exclusion Standard data for cleatsshop.com
Resource Scan
Scan Details
| Site Domain | cleatsshop.com |
| Base Domain | cleatsshop.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-08T17:29:32+00:00 |
| Next Scan | 2026-03-08T17:29:32+00:00 |
Last Successful Scan
| Scanned | 2025-07-07T17:52:09+00:00 |
| URL | https://cleatsshop.com/robots.txt |
| Redirect | https://www.cleatsshop.net/robots.txt |
| Redirect Domain | www.cleatsshop.net |
| Redirect Base | cleatsshop.net |
| Domain IPs | 104.26.12.171, 104.26.13.171, 172.67.70.78, 2606:4700:20::681a:cab, 2606:4700:20::681a:dab, 2606:4700:20::ac43:464e |
| Redirect IPs | 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f |
| Response IP | 104.26.6.118 |
| Found | Yes |
| Hash | 87726ca6052842c8ee0d5e29b38c923a6f43a1d005607ddde1ff7799731c5a34 |
| SimHash | e01a8651eb91 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /app/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /shell/ |
| Disallow | /var/ |
| Disallow | /404/ |
| Disallow | /contacts/ |
| Disallow | /about-us/ |
| Disallow | /faq/ |
| Disallow | /returns-exchanges/ |
| Disallow | /shipping/ |
| Disallow | /payment/ |
| Disallow | /returns/ |
| Disallow | /pay-after-delivery/ |
| Disallow | /*?dir* |
| Disallow | /*?limit* |
| Disallow | /*?mode* |
| Disallow | /*?___from_store=* |
| Disallow | /*?___store=* |
| Disallow | /*?cat=* |
| Disallow | /*?q=* |
| Disallow | /*?price=* |
| Disallow | /*?availability=* |
| Disallow | /*?brand=* |
| Disallow | /*?product_type=* |
| Disallow | /*?color=* |
| Disallow | /*?SID=* |
| Disallow | /customer/account/* |
| Disallow | /catalogsearch/* |
| Disallow | /catalog/product_compare/* |
| Disallow | /catalog/category/view/* |
| Disallow | /catalog/product/view/* |
| Disallow | /directory/currency/switch/currency/* |
| Disallow | /kids-products/* |
| Disallow | /review/product/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cleatsshop.com/products-sitemap.xml |