oricon.co.jp
robots.txt

Robots Exclusion Standard data for oricon.co.jp

Resource Scan

Scan Details

Site Domain oricon.co.jp
Base Domain oricon.co.jp
Scan Status Ok
Last Scan2024-09-26T17:46:26+00:00
Next Scan 2024-10-03T17:46:26+00:00

Last Scan

Scanned2024-09-26T17:46:26+00:00
URL https://oricon.co.jp/robots.txt
Redirect https://www.oricon.co.jp/robots.txt
Redirect Domain www.oricon.co.jp
Redirect Base oricon.co.jp
Domain IPs 104.18.250.41, 104.18.251.41
Redirect IPs 104.18.250.41, 104.18.251.41
Response IP 104.18.250.41
Found Yes
Hash 99a412e799305dbbb5e91a2cc46c0aba44ee3da6798b276f6a1da0f007c2d36d
SimHash c90453142f82

Groups

googlebot-news
*

Rule Path
Disallow /dealer/index.php*
Disallow /dealer/amazon*
Disallow /_cdsales/redirect.php*
Disallow /clickheat/
Disallow /pj/
Disallow /_ajax/recommend/redirect.php*
Allow /pj/img/
Allow /pj/ln/cs/ft_cs.css
Allow /pj/ln/cs/ft_csnews.css
Allow /pj/ln/cs/hd_cs.css
Allow /pj/ln/cs/hd_csnews.css
Allow /pj/ln/cs/hd_englishcsnews.css
Allow /pj/ln/cs/hd_jukencsnews.css
Allow /pj/ln/cs/hd_life.css
Allow /pj/ln/cs/method_cs.css
Disallow /dealer/rakutenbooks*
Disallow /common/
Allow /common/js/

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

taggy

Rule Path
Disallow /

*

Rule Path
Disallow /maintenance/

mail.ru_bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.oricon.co.jp/sitemap/sitemap_prof_update_index.xml
sitemap https://www.oricon.co.jp/sitemap/rank/sitemap_update.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_video_all.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_news_embed_video.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_special_index.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_tag_all_index.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_news_index.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_photo_index.xml
sitemap https://www.oricon.co.jp/sitemap/sitemap_other.xml
sitemap http://www.oricon.co.jp/gglnews3sd5f4sda65f464.php

Comments

  • Baidu chinese search engine
  • RUSSIA search engine
  • sogou.com chinese search engine
  • User-agent: Sogou web spider
  • Disallow: /
  • Grapeshot Allow