Log In Sign Up

kochinews.co.jp
robots.txt

Robots Exclusion Standard data for kochinews.co.jp

Resource Scan

Scan Details

Site Domain kochinews.co.jp
Base Domain kochinews.co.jp
Scan Status Ok
Last Scan2024-06-01T05:26:21+00:00
Next Scan 2024-06-08T05:26:21+00:00

Last Scan

Scanned2024-06-01T05:26:21+00:00
URL https://www.kochinews.co.jp/robots.txt
Domain IPs 13.35.18.120, 13.35.18.54, 13.35.18.56, 13.35.18.66
Response IP 13.35.18.66
Found Yes
Hash 4461a572e7aeac2533bfc1793e044d9ac627798cbfcb8c1c321080da92718220
SimHash 64206d058981

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

icc-crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

*

Rule Path
Disallow /api/
Back to top

Other Records

Field Value
sitemap https://www.kochinews.co.jp/sitemap.xml
Back to top

Comments

  • GoogleBot ( 最短間隔: 15 [ s ] )
  • -> Crawl-delay は効果が無いと言われているが試しに！
  • MicrosoftBingBot ( 最短間隔: 15 [ s ] )
  • YahooSlurp ( 最短間隔: 15 [ s ] )
  • ICCクローラ ( 最短間隔: 15 [ s ] )
  • 202.180.34.186, 61.86.246.72 <> URL: https://ucri.nict.go.jp/icccrawler.html
Back to top