sbc21.co.jp
robots.txt

Robots Exclusion Standard data for sbc21.co.jp

Resource Scan

Scan Details

Site Domain sbc21.co.jp
Base Domain sbc21.co.jp
Scan Status Ok
Last Scan2024-11-11T21:21:39+00:00
Next Scan 2024-11-18T21:21:39+00:00

Last Scan

Scanned2024-11-11T21:21:39+00:00
URL https://sbc21.co.jp/robots.txt
Domain IPs 202.247.197.62
Response IP 202.247.197.62
Found Yes
Hash a8f74c383b197f74e0a74999885c11ed9d2372db703b95cfa809dffa4a034374
SimHash c116f314c590

Groups

mediapartners-google

Rule Path
Disallow /data/
Disallow /error/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /ads/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

googlebot

Rule Path
Disallow /data/
Disallow /error/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

googlebot-mobile

Rule Path
Disallow /data/
Disallow /error/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

slurp

Rule Path
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

y!j-srd

Rule Path
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

y!j-mbs

Rule Path
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

bingbot

Rule Path
Disallow /data/
Disallow /error/
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

Other Records

Field Value
crawl-delay 30

moget

Rule Path
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

ichiro/mobile goo

Rule Path
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

baiduspider

Rule Path
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

baiduimagespider

Rule Path
Disallow /news/
Disallow /ads/
Disallow /Maildir/
Disallow /my-cgi/
Disallow /Template/
Disallow /vision/
Disallow /*/senkyo/
Disallow /*/Template/
Disallow /emg/
Disallow /yhpr/
Disallow /common/
Disallow /commons/
Disallow /css/
Disallow /hanyou-form/
Disallow /extfeed/
Disallow /js/
Disallow /mailform/
Disallow /maintenance/
Disallow /perl-lib/
Disallow /php/
Disallow /script/
Disallow /vision/

radikocrawler/-1.1

Rule Path
Allow /data/sbc/radio/pgm/

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sbc21.co.jp/sitemap/sitemap.xml

Comments

  • Google Adense
  • bing
  • radiko
  • Twitter bot‹–‰Â