cypresscraft.com
robots.txt

Robots Exclusion Standard data for cypresscraft.com

Resource Scan

Scan Details

Site Domain cypresscraft.com
Base Domain cypresscraft.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-14T09:01:27+00:00
Next Scan 2024-06-12T09:01:27+00:00

Last Successful Scan

Scanned2022-11-12T20:51:56+00:00
URL https://cypresscraft.com/robots.txt
Response IP 52.84.45.9, 52.84.45.97, 52.84.45.15, 52.84.45.113
Found Yes
Hash 364f3cea07029686a08ff6d3c55c12510212cff76333b1c6212f5f4cab6883f3
SimHash 591cc67ace31

Groups

blexbot
seznambot
ccbot
spbot
screaming
semrushbot
mj12bot
baiduspider
yandex
mauibot
linguee

Rule Path
Disallow /

dotbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /index.php/dashboard
Disallow /lib/ClickTale/
Disallow /catalogsearch
Disallow /api/
Disallow /checkout/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Allow /customer/account/login/
Allow /index.php$
Allow /index.php?

Other Records

Field Value
sitemap https://cypresscraft.com/sitemap_index.xml