zencart.com
robots.txt

Robots Exclusion Standard data for zencart.com

Resource Scan

Scan Details

Site Domain zencart.com
Base Domain zencart.com
Scan Status Ok
Last Scan2025-05-03T08:26:26+00:00
Next Scan 2025-05-17T08:26:26+00:00

Last Scan

Scanned2025-05-03T08:26:26+00:00
URL https://zencart.com/robots.txt
Redirect https://www.zen-cart.com/robots.txt
Redirect Domain www.zen-cart.com
Redirect Base zen-cart.com
Domain IPs 104.21.62.235, 172.67.140.35, 2606:4700:3032::6815:3eeb, 2606:4700:3036::ac43:8c23
Redirect IPs 104.21.88.64, 172.67.173.159, 2606:4700:3035::6815:5840, 2606:4700:3035::ac43:ad9f
Response IP 104.21.88.64
Found Yes
Hash c9d86ff561e889be5a3d75a90c69ab2fe8851ddb19f83915eb8ac80e1ff1035c
SimHash 1705d070d215

Groups

*

Rule Path
Disallow /*/blackhole/*
Disallow /images/
Disallow /archived_contributions/
Disallow *redlink*

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow /images/
Disallow /archived_contributions/
Disallow *redlink*

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /images/
Disallow /archived_contributions/
Disallow *redlink*

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow *
Disallow /

Other Records

Field Value
crawl-delay 25

baiduspider

Rule Path
Disallow *
Disallow /

Other Records

Field Value
crawl-delay 25

ahrefsbot

Rule Path
Disallow /
Disallow *

semrushbot

Rule Path
Disallow /
Disallow *

neevabot

Rule Path
Disallow /
Disallow *

amazonbot

Rule Path
Disallow /
Disallow *

petalbot

Rule Path
Disallow /
Disallow *