cleatsshop.net
robots.txt
Robots Exclusion Standard data for cleatsshop.net
Resource Scan
Scan Details
| Site Domain | cleatsshop.net |
| Base Domain | cleatsshop.net |
| Scan Status | Ok |
| Last Scan | 2025-11-17T01:57:16+00:00 |
| Next Scan | 2025-12-17T01:57:16+00:00 |
Last Scan
| Scanned | 2025-11-17T01:57:16+00:00 |
| URL | https://cleatsshop.net/robots.txt |
| Domain IPs | 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f |
| Response IP | 172.67.69.79 |
| Found | Yes |
| Hash | 87726ca6052842c8ee0d5e29b38c923a6f43a1d005607ddde1ff7799731c5a34 |
| SimHash | e01a8651eb91 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /app/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /shell/ |
| Disallow | /var/ |
| Disallow | /404/ |
| Disallow | /contacts/ |
| Disallow | /about-us/ |
| Disallow | /faq/ |
| Disallow | /returns-exchanges/ |
| Disallow | /shipping/ |
| Disallow | /payment/ |
| Disallow | /returns/ |
| Disallow | /pay-after-delivery/ |
| Disallow | /*?dir* |
| Disallow | /*?limit* |
| Disallow | /*?mode* |
| Disallow | /*?___from_store=* |
| Disallow | /*?___store=* |
| Disallow | /*?cat=* |
| Disallow | /*?q=* |
| Disallow | /*?price=* |
| Disallow | /*?availability=* |
| Disallow | /*?brand=* |
| Disallow | /*?product_type=* |
| Disallow | /*?color=* |
| Disallow | /*?SID=* |
| Disallow | /customer/account/* |
| Disallow | /catalogsearch/* |
| Disallow | /catalog/product_compare/* |
| Disallow | /catalog/category/view/* |
| Disallow | /catalog/product/view/* |
| Disallow | /directory/currency/switch/currency/* |
| Disallow | /kids-products/* |
| Disallow | /review/product/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cleatsshop.com/products-sitemap.xml |