chiroplanet.net
robots.txt

Robots Exclusion Standard data for chiroplanet.net

Resource Scan

Scan Details

Site Domain chiroplanet.net
Base Domain chiroplanet.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-19T23:31:58+00:00
Next Scan 2024-10-17T23:31:58+00:00

Last Successful Scan

Scanned2024-02-28T20:05:03+00:00
URL https://www.chiroplanet.net/robots.txt
Domain IPs 104.21.1.33, 172.67.186.119, 2606:4700:3036::6815:121, 2606:4700:3037::ac43:ba77
Response IP 172.67.186.119
Found Yes
Hash 75166f9f558ee3429807b7081d5186fc23c097716f51b517cd385bb16b9c91f5
SimHash 7c165543ae8b

Groups

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

companybook

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

healthbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

contacts-crawler

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /shared/trap/
Disallow /index.php?privacy=website
Disallow *newscatID%3D*
Disallow *articleid%3D*
Disallow *versionID%3D*
Disallow *archID%3D*

aspiegelbot

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow Sogou

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://chiroplanet.net/shared/feeds/sitemap.php

Comments

  • http://www.become.com/site_owners.html
  • Huawei