Log In Sign Up

rmp.geenius.ee
robots.txt

Robots Exclusion Standard data for rmp.geenius.ee

Resource Scan

Scan Details

Site Domain rmp.geenius.ee
Base Domain geenius.ee
Scan Status Ok
Last Scan2024-10-06T06:26:33+00:00
Next Scan 2024-11-05T06:26:33+00:00

Last Scan

Scanned2024-10-06T06:26:33+00:00
URL https://rmp.geenius.ee/robots.txt
Domain IPs 217.146.68.126
Response IP 217.146.68.126
Found Yes
Hash 2e29bdc71bbe9c894c7227a6c8e3fb9ac307712b38acade87c21eb2d0338efa4
SimHash a220d902c202

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /*?*

Other Records

Field Value
crawl-delay 10

semrushbot
semrushbot
semrushbot-sa
mj12bot

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /*add-to-cart%3D*

google-extended

Rule Path
Disallow /
Back to top

Comments

  • Goo (JP)
  • Info (Japanese): http://help.goo.ne.jp/help/article/704/
  • Info (English): http://help.goo.ne.jp/help/article/853/
  • Naver (KR)
  • Info: http://help.naver.com/customer/etc/webDocument02.nhn
  • Baidu (CN)
  • Info: http://www.baidu.com/search/spider.htm
  • SoGou (CN)
  • Info: http://www.sogou.com/docs/help/webmasters.htm#07
  • Youdao (CN)
  • Info: http://www.youdao.com/help/webmaster/spider/
Back to top