pcmax.jp
robots.txt

Robots Exclusion Standard data for pcmax.jp

Resource Scan

Scan Details

Site Domain pcmax.jp
Base Domain pcmax.jp
Scan Status Ok
Last Scan2024-10-05T21:31:34+00:00
Next Scan 2024-10-12T21:31:34+00:00

Last Scan

Scanned2024-10-05T21:31:34+00:00
URL https://pcmax.jp/robots.txt
Domain IPs 13.35.215.139
Response IP 13.35.215.139
Found Yes
Hash cde6ac820aeb14962375e72e79a89f16b9a3cffdf1ef0d3125d18f625b5c0ba6
SimHash 4d6452a4e411

Groups

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /pc/
Disallow /rm

*

Rule Path
Disallow /mobile/trial_bbs.php?*
Disallow /mobile/trial_bbs_detail.php?*
Disallow /pcm/shame.php?*
Disallow /pcm/open_google.php?*
Disallow /app/

Comments

  • USA Alexa : alexa.com/
  • China Baidu : www.baidu.com, www.baidu.jp
  • China Baidu : www.baidu.com, www.baidu.jp
  • China Yodao : www.yodao.com
  • Korea Naver : www.naver.com 29/Mar/2007~
  • Korea Naver : www.naver.com ~26/Mar/2007?
  • Disallow: /mobile/
  • Googlebot
  • User-agent: APIs-Google
  • Disallow: /mobile/
  • APIs-Google
  • User-agent: Mediapartners-Google
  • Disallow: /mobile/
  • Mediapartners-Google
  • User-agent: AdsBot-Google-Mobile
  • Disallow: /mobile/
  • AdsBot-Google-Mobile
  • User-agent: Googlebot-Image
  • Disallow: /mobile/
  • Googlebot-Image
  • User-agent: Googlebot-Video
  • Disallow: /mobile/
  • Googlebot-Video
  • User-agent: Googlebot-News
  • Disallow: /mobile/
  • Googlebot-News
  • User-agent: AdsBot-Google-Mobile-Apps
  • Disallow: /mobile/
  • AdsBot-Google-Mobile-Apps
  • 全クローラー