shashingift.jp
robots.txt

Robots Exclusion Standard data for shashingift.jp

Resource Scan

Scan Details

Site Domain shashingift.jp
Base Domain shashingift.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-31T02:12:53+00:00
Next Scan 2024-10-29T02:12:53+00:00

Last Successful Scan

Scanned2024-03-11T02:08:30+00:00
URL https://shashingift.jp/robots.txt
Redirect https://www.shashingift.jp/robots.txt
Redirect Domain www.shashingift.jp
Redirect Base shashingift.jp
Domain IPs 13.33.88.109, 13.33.88.66, 13.33.88.7, 13.33.88.98
Redirect IPs 13.33.88.109, 13.33.88.66, 13.33.88.7, 13.33.88.98
Response IP 13.33.88.98
Found Yes
Hash 5eec4dcd06bdb4be3732ad9fcaf378f2af8fc5655f0b0e1ac45a679ca7615a02
SimHash 48019962eb94

Groups

adsbot-google
adsbot-google-mobile
*

Rule Path
Disallow /store/
Disallow /estore/design/
Disallow /estore/basket
Disallow /estore/mobile/
Disallow /estore/preview/
Disallow /estore/account/
Disallow /estore/montage/
Disallow /estore/productdesign/
Disallow /estore/mvcupload/
Disallow /estore/order/
Disallow /estore/ruler/
Disallow /estore/BraintreeDropinUi/
Disallow /estore/paypal/
Disallow /estore/validation/
Disallow /estore/instagram/
Disallow /estore/clientcheckout/
Disallow /estore/PreviewHelp/
Disallow /estore/api/
Disallow /estore/contrado3d/
Disallow /contest/submit
Disallow /estore/StoresApi/GetStoreProductInfo
Allow /estore/api/price/

rogerbot

Rule Path
Disallow /ugc/
Disallow /eStore/
Disallow /blog/category/
Disallow /blog/tag/
Disallow /estore/
Disallow /gifts/
Disallow /include/
Disallow /stores/
Disallow /media/
Disallow /resources/
Disallow /faq/
Disallow /blog/author/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.shashingift.jp/Sitemap.xml
sitemap https://www.shashingift.jp/storesitemap.xml
sitemap https://www.shashingift.jp/storecollectionsitemap.xml