cremashop.eu
robots.txt

Robots Exclusion Standard data for cremashop.eu

Resource Scan

Scan Details

Site Domain cremashop.eu
Base Domain cremashop.eu
Scan Status Ok
Last Scan2025-07-22T17:30:31+00:00
Next Scan 2025-08-21T17:30:31+00:00

Last Scan

Scanned2025-07-22T17:30:31+00:00
URL https://cremashop.eu/robots.txt
Redirect https://www.cremashop.eu/robots.txt
Redirect Domain www.cremashop.eu
Redirect Base cremashop.eu
Domain IPs 172.66.40.252, 172.66.43.4, 2606:4700:3108::ac42:28fc, 2606:4700:3108::ac42:2b04
Redirect IPs 172.66.40.252, 172.66.43.4, 2606:4700:3108::ac42:28fc, 2606:4700:3108::ac42:2b04
Response IP 172.66.40.252
Found Yes
Hash 34ea69650fb5277c40015647a56edd84e2d81f5ce1ce790a41683db9aae38619
SimHash 23358a68eb33

Groups

*

Rule Path
Disallow /*/customer*
Disallow /*/cart*
Disallow /*/checkout*
Disallow /*/setcountry/
Disallow /*/setcurrency/
Disallow /*/setfavorite/
Disallow /*/login
Disallow /*/password-request
Disallow /*/search/
Disallow /track/view

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /