genbaichiba.com
robots.txt

Robots Exclusion Standard data for genbaichiba.com

Resource Scan

Scan Details

Site Domain genbaichiba.com
Base Domain genbaichiba.com
Scan Status Ok
Last Scan2024-06-21T08:10:07+00:00
Next Scan 2024-07-21T08:10:07+00:00

Last Scan

Scanned2024-06-21T08:10:07+00:00
URL https://genbaichiba.com/robots.txt
Redirect https://www.genbaichiba.com/robots.txt
Redirect Domain www.genbaichiba.com
Redirect Base genbaichiba.com
Domain IPs 202.214.54.102
Redirect IPs 108.156.133.110, 108.156.133.21, 108.156.133.28, 108.156.133.52
Response IP 108.156.133.21
Found Yes
Hash 5e7ada89043f226fa2b6a9fccb7ab15a4ab4cbe976f927f25a8ac48f5fecbe86
SimHash 7b17d844c733

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /shop/cart/
Disallow /shop/customer/
Disallow /shop/goods/
Disallow /shop/order/

Other Records

Field Value
sitemap https://www.genbaichiba.com/Sitemap_index.xml