cremashop.eu
robots.txt
Robots Exclusion Standard data for cremashop.eu
Resource Scan
Scan Details
Site Domain | cremashop.eu |
Base Domain | cremashop.eu |
Scan Status | Ok |
Last Scan | 2025-07-22T17:30:31+00:00 |
Next Scan | 2025-08-21T17:30:31+00:00 |
Last Scan
Scanned | 2025-07-22T17:30:31+00:00 |
URL | https://cremashop.eu/robots.txt |
Redirect | https://www.cremashop.eu/robots.txt |
Redirect Domain | www.cremashop.eu |
Redirect Base | cremashop.eu |
Domain IPs | 172.66.40.252, 172.66.43.4, 2606:4700:3108::ac42:28fc, 2606:4700:3108::ac42:2b04 |
Redirect IPs | 172.66.40.252, 172.66.43.4, 2606:4700:3108::ac42:28fc, 2606:4700:3108::ac42:2b04 |
Response IP | 172.66.40.252 |
Found | Yes |
Hash | 34ea69650fb5277c40015647a56edd84e2d81f5ce1ce790a41683db9aae38619 |
SimHash | 23358a68eb33 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/customer* |
Disallow | /*/cart* |
Disallow | /*/checkout* |
Disallow | /*/setcountry/ |
Disallow | /*/setcurrency/ |
Disallow | /*/setfavorite/ |
Disallow | /*/login |
Disallow | /*/password-request |
Disallow | /*/search/ |
Disallow | /track/view |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |