sun-a.com
robots.txt

Robots Exclusion Standard data for sun-a.com

Resource Scan

Scan Details

Site Domain sun-a.com
Base Domain sun-a.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-03T00:28:02+00:00
Next Scan 2024-12-02T00:28:02+00:00

Last Successful Scan

Scanned2024-07-13T00:16:14+00:00
URL https://www.sun-a.com/robots.txt
Redirect https://shop.san-ei-corp.co.jp/robots.txt
Redirect Domain shop.san-ei-corp.co.jp
Redirect Base san-ei-corp.co.jp
Domain IPs 160.16.148.55
Redirect IPs 160.16.148.55
Response IP 160.16.148.55
Found Yes
Hash 832957922edddd2e62d9308eafb2bd26dae8cfdbdeeb8a4f79be5a52a7fb39f0
SimHash 800cdf04c491

Groups

barkrowler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

*

Rule Path
Disallow /cart/
Disallow /mobile/cart/
Disallow /lib/
Disallow /cms/