hyogen.info
robots.txt

Robots Exclusion Standard data for hyogen.info

Resource Scan

Scan Details

Site Domain hyogen.info
Base Domain hyogen.info
Scan Status Ok
Last Scan2024-09-22T04:24:13+00:00
Next Scan 2024-09-29T04:24:13+00:00

Last Scan

Scanned2024-09-22T04:24:13+00:00
URL https://hyogen.info/robots.txt
Domain IPs 160.16.101.39
Response IP 160.16.101.39
Found Yes
Hash 1dfb29ad2e9ed96ec9a38953a428ae180b2b43923e1f80dfa6cbd9ce4b0c344a
SimHash 671b3086c5ac

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Comments

  • 20170218
  • bingbot のアクセスが多いので頻度を減らす
  • 同じサーバーにあるサブドメインにもファイルを置く