drwoodydc.com
robots.txt

Robots Exclusion Standard data for drwoodydc.com

Resource Scan

Scan Details

Site Domain drwoodydc.com
Base Domain drwoodydc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-26T23:42:21+00:00
Next Scan 2024-10-24T23:42:21+00:00

Last Successful Scan

Scanned2024-03-06T23:34:36+00:00
URL https://drwoodydc.com/robots.txt
Domain IPs 104.21.8.99, 172.67.130.109, 2606:4700:3034::ac43:826d, 2606:4700:3037::6815:863
Response IP 172.67.130.109
Found Yes
Hash a3c431488b631b6c74a15384196a22f134b824bd306f4bb05dc99b9dfe778593
SimHash 78165703ee8b

Groups

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

companybook

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

healthbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

contacts-crawler

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /shared/trap/
Disallow /index.php?privacy=website
Disallow *newscatID%3D*
Disallow *articleid%3D*
Disallow *versionID%3D*
Disallow *archID%3D*

aspiegelbot

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow Sogou

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.chiropractique.net/shared/feeds/sitemap.php

Comments

  • http://www.become.com/site_owners.html
  • Huawei