datastical.com
robots.txt

Robots Exclusion Standard data for datastical.com

Resource Scan

Scan Details

Site Domain datastical.com
Base Domain datastical.com
Scan Status Ok
Last Scan2024-09-26T17:42:26+00:00
Next Scan 2024-10-03T17:42:26+00:00

Last Scan

Scanned2024-09-26T17:42:26+00:00
URL https://datastical.com/robots.txt
Redirect https://www.datastical.com/robots.txt
Redirect Domain www.datastical.com
Redirect Base datastical.com
Domain IPs 94.23.208.201
Redirect IPs 94.23.208.201
Response IP 94.23.208.201
Found Yes
Hash adc17211fe4f9687f183094adfca053ae6ae846535fb2b3a9aedec77f680317c
SimHash d05dc2604633

Groups

*

Rule Path
Allow /

magpie-crawler

Rule Path
Disallow /

wikido

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

exabot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

xenu

Rule Path
Disallow /

*

Rule Path
Disallow /medical/filter-results