dancyu.com
robots.txt

Robots Exclusion Standard data for dancyu.com

Resource Scan

Scan Details

Site Domain dancyu.com
Base Domain dancyu.com
Scan Status Ok
Last Scan2024-09-29T10:51:21+00:00
Next Scan 2024-10-29T10:51:21+00:00

Last Scan

Scanned2024-09-29T10:51:21+00:00
URL https://dancyu.com/robots.txt
Redirect https://www.dancyu.com:443/robots.txt
Redirect Domain www.dancyu.com
Redirect Base dancyu.com
Domain IPs 52.198.141.1, 54.168.152.254
Redirect IPs 52.198.141.1, 54.168.152.254
Response IP 52.198.141.1
Found Yes
Hash 88b919fc62d261b38797b5c0b304c0988be2b2b3ce4ee30189c1fa184410a1cc
SimHash 891c4c0aff30

Groups

*

Rule Path
Disallow /user/cart
Disallow /user/checkout
Disallow /user/member
Disallow /user/subscription
Disallow /admin
Disallow /shop-admin

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

serpstatbot/2.0

Rule Path
Disallow /