crecos.com
robots.txt
Robots Exclusion Standard data for crecos.com
Resource Scan
Scan Details
Site Domain | crecos.com |
Base Domain | crecos.com |
Scan Status | Ok |
Last Scan | 2024-09-17T04:10:44+00:00 |
Next Scan | 2024-10-17T04:10:44+00:00 |
Last Scan
Scanned | 2024-09-17T04:10:44+00:00 |
URL | https://www.crecos.com/robots.txt |
Domain IPs | 108.157.254.23, 108.157.254.50, 108.157.254.53, 108.157.254.83, 2600:9000:2753:200:17:8790:1000:93a1, 2600:9000:2753:8c00:17:8790:1000:93a1, 2600:9000:2753:b400:17:8790:1000:93a1, 2600:9000:2753:d600:17:8790:1000:93a1, 2600:9000:2753:de00:17:8790:1000:93a1, 2600:9000:2753:e200:17:8790:1000:93a1, 2600:9000:2753:e400:17:8790:1000:93a1, 2600:9000:2753:e800:17:8790:1000:93a1 |
Response IP | 108.157.254.23 |
Found | Yes |
Hash | 60f64439280f81e700605ac3a4981e9e63cec158606dbcdcb163f833a94d7cee |
SimHash | 4e301974bcd7 |
Groups
*
Rule | Path |
---|---|
Disallow | /*OrderBy |
Disallow | /*map |
Disallow | /*score |
Disallow | /*% |
Disallow | /*bestPricePerSalesChannel |
Disallow | /*specificationFilter |
Disallow | /*OrderByBestDiscountDESC |
Disallow | /*%26 |
Disallow | /*initialQuery |
Disallow | /*reviewRate |
Disallow | /*OrderByPriceASC |
Disallow | /*%40 |
Disallow | /*initialMap |
Disallow | /login |
Disallow | /checkout |
Other Records
Field | Value |
---|---|
sitemap | https://www.crecos.com/sitemap.xml |