Log In Sign Up

betterhealth.jp
robots.txt

Robots Exclusion Standard data for betterhealth.jp

Resource Scan

Scan Details

Site Domain betterhealth.jp
Base Domain betterhealth.jp
Scan Status Ok
Last Scan2024-06-07T03:28:11+00:00
Next Scan 2024-07-07T03:28:11+00:00

Last Scan

Scanned2024-06-07T03:28:11+00:00
URL https://betterhealth.jp/robots.txt
Domain IPs 104.26.0.88, 104.26.1.88, 172.67.72.197, 2606:4700:20::681a:158, 2606:4700:20::681a:58, 2606:4700:20::ac43:48c5
Response IP 172.67.72.197
Found Yes
Hash 558bf4ae92dc479b56e25fa59bcffcc5058bb5e0575ec22e1cb1469fb6018db6
SimHash c80bdc43d912

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /feed/
Allow /
Disallow /product-tag/
Disallow /?page_id=
Disallow /diet/

googlebot

Rule Path
Disallow *product-tag*
Disallow *feed*
Disallow *add_to_wishlist*
Disallow /2020/*
Disallow /2019/*

*

Rule Path
Disallow *product-tag*
Disallow *feed*
Disallow *add_to_wishlist*
Disallow /?amp%2F
Disallow /amp/

twitterbot

Rule Path
Allow *

twitterbot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://betterhealth.jp/sitemap.xml
Back to top

Comments

  • This robots.txt file was created by Robots.txt Rewrite plugin: https://wordpress.org/plugins/robotstxt-rewrite/
Back to top

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
Back to top