shizuokagas.co.jp
robots.txt

Robots Exclusion Standard data for shizuokagas.co.jp

Resource Scan

Scan Details

Site Domain shizuokagas.co.jp
Base Domain shizuokagas.co.jp
Scan Status Ok
Last Scan2024-09-20T19:09:50+00:00
Next Scan 2024-10-20T19:09:50+00:00

Last Scan

Scanned2024-09-20T19:09:50+00:00
URL https://www.shizuokagas.co.jp/robots.txt
Domain IPs 23.59.168.96
Response IP 23.59.168.96
Found Yes
Hash b3bc5b6143378486823db178da3c4ea4433bd6e454dd8f226590dc20ec7a409a
SimHash 6b1fd00061b0

Groups

*

Rule Path
Disallow /business
Disallow /company
Disallow /home
Disallow /inquiry
Disallow /sitemap
Disallow /sp

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Disallow /information/newsflash/2013/
Disallow /information/newsflash/2012/
Disallow /information/newsflash/2011/
Disallow /information/newsflash/2010/
Disallow /information/newsflash/2009/
Disallow /information/newsflash/2008/

Comments

  • ‘S‚ẴNƒ[ƒ‰[‚ð‘ΏÛ