kawarthanow.com
robots.txt

Robots Exclusion Standard data for kawarthanow.com

Resource Scan

Scan Details

Site Domain kawarthanow.com
Base Domain kawarthanow.com
Scan Status Ok
Last Scan2024-09-27T20:04:37+00:00
Next Scan 2024-10-04T20:04:37+00:00

Last Scan

Scanned2024-09-27T20:04:37+00:00
URL https://kawarthanow.com/robots.txt
Domain IPs 158.69.252.221
Response IP 158.69.252.221
Found Yes
Hash 80e05188c636ab87971d1070480609c75af25e0c364b6ea561a730ca0a4b533e
SimHash 5a0f7c408b10

Groups

*

Rule Path
Disallow /data/
Disallow /bin/
Disallow /wp-admin/
Disallow /wp-login.php

Other Records

Field Value
crawl-delay 30

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

Comments

  • Baiduspider
  • Yandex
  • SemrushBot
  • Megaindex
  • Megaindex