beauty-cdn.oricon.co.jp
robots.txt

Robots Exclusion Standard data for beauty-cdn.oricon.co.jp

Resource Scan

Scan Details

Site Domain beauty-cdn.oricon.co.jp
Base Domain oricon.co.jp
Scan Status Ok
Last Scan2024-04-25T08:23:38+00:00
Next Scan 2024-05-25T08:23:38+00:00

Last Scan

Scanned2024-04-25T08:23:38+00:00
URL https://beauty-cdn.oricon.co.jp/robots.txt
Domain IPs 104.18.250.41, 104.18.251.41
Response IP 104.18.251.41
Found Yes
Hash 43a0edbae9afaa78710e2e56ca61401ee4d2b8a890e0768b15d17a7c5b1ceda4
SimHash 8364dab02b7a

Groups

*

Rule Path
Disallow /common/inc/
Disallow /rank_esthe/smartphoneApp/
Disallow /rank_mens/smartphoneApp/
Disallow /rank_cosme/smartphoneApp/
Disallow /rank_diet/smartphoneApp/
Disallow /rank_fitness/smartphoneApp/
Disallow /shika/shinbi/smartphoneApp/
Disallow /shika/kyousei/smartphoneApp/
Disallow /shika/implant/smartphoneApp/

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

Other Records

Field Value
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_news_all_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_news_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_special_all_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_special_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_photo_all_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_photo_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_tag_all_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_column_all_index.xml
sitemap http://beauty.oricon.co.jp/sitemap/sitemap_column_index.xml

Comments

  • Disallow: /css/
  • Disallow: /js/