Log In Sign Up

franklinplanner.com
robots.txt

Robots Exclusion Standard data for franklinplanner.com

Resource Scan

Scan Details

Site Domain franklinplanner.com
Base Domain franklinplanner.com
Scan Status Ok
Last Scan2024-05-23T10:18:21+00:00
Next Scan 2024-06-22T10:18:21+00:00

Last Scan

Scanned2024-05-23T10:18:21+00:00
URL https://franklinplanner.com/robots.txt
Domain IPs 216.194.124.84
Response IP 216.194.124.84
Found Yes
Hash c87395f6a943da0effc27501fbb46dbe50f986a9154c832280271d33f84f7080
SimHash 143cde109d9b

Groups

yandex

Product Comment
yandex will be used by all Yandex robots
Rule Path Comment
Disallow / block all indexing

semrushbot

Rule Path Comment
Disallow / block all indexing

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

atomz/1.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /
Back to top

Comments

  • Yandex bots from Russia https://yandex.com/support/webmaster/robot-workings/robot.html
  • http://www.semrush.com/bot.html)
  • https://ahrefs.com/robot/
  • https://moz.com/researchtools/ose/dotbot
  • https://mj12bot.com/
  • http://www.scoutjet.com/
  • https://www.changedetection.com/bot.html
  • http://webmeup-crawler.com/
Back to top