minato-yamaguchi.co.jp
robots.txt

Robots Exclusion Standard data for minato-yamaguchi.co.jp

Resource Scan

Scan Details

Site Domain minato-yamaguchi.co.jp
Base Domain minato-yamaguchi.co.jp
Scan Status Ok
Last Scan2024-11-08T23:36:24+00:00
Next Scan 2024-11-15T23:36:24+00:00

Last Scan

Scanned2024-11-08T23:36:24+00:00
URL https://minato-yamaguchi.co.jp/robots.txt
Redirect https://www.minato-yamaguchi.co.jp/robots.txt
Redirect Domain www.minato-yamaguchi.co.jp
Redirect Base minato-yamaguchi.co.jp
Domain IPs 160.16.65.45
Redirect IPs 160.16.65.45
Response IP 160.16.65.45
Found Yes
Hash f6bce05fbf7c421b50b1a471953cfb98427e7752c72321aed237f829e80f59c6
SimHash 887c5104d6f4

Groups

*

Rule Path
Disallow /

googlebot
bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

mediapartners-google
clipper
ichiro
twitterbot

Rule Path
Disallow

Comments

  • 次のクローラーはアクセス許可
  • 20230131 不明なuseragentの為無効化
  • User-agent: adsence-Google
  • 20230131 アドセンスのクローラーを追åŠ
  • 山口電子版twttercard使用のためアクセス許可