store.franklinplanner.com
robots.txt

Robots Exclusion Standard data for store.franklinplanner.com

Resource Scan

Scan Details

Site Domain store.franklinplanner.com
Base Domain franklinplanner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-19T20:54:57+00:00
Next Scan 2024-07-18T20:54:57+00:00

Last Successful Scan

Scanned2024-02-27T19:17:51+00:00
URL https://store.franklinplanner.com/robots.txt
Domain IPs 63.141.128.14
Response IP 63.141.128.14
Found Yes
Hash efee3424fc6363c5de7d30ce2436f5fc0d0c6fd57e5daa34df43970f8cf13822
SimHash 1b3cde10c99d

Groups

*

Rule Path
Disallow /account.php
Disallow /cart.php
Disallow /checkout.php
Disallow /checkout
Disallow /finishorder.php
Disallow /login.php
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php
Disallow /viewfile.php
Disallow /wishlist.php
Disallow /admin/
Disallow /__socialshop/

yandex

Product Comment
yandex will be used by all Yandex robots
Rule Path Comment
Disallow / block all indexing

semrushbot

Rule Path Comment
Disallow / block all indexing

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

atomz/1.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*

Comments

  • Yandex bots from Russia https://yandex.com/support/webmaster/robot-workings/robot.html
  • http://www.semrush.com/bot.html)
  • https://ahrefs.com/robot/
  • https://moz.com/researchtools/ose/dotbot
  • https://mj12bot.com/
  • http://www.scoutjet.com/
  • https://www.changedetection.com/bot.html
  • http://webmeup-crawler.com/