helisports.be
robots.txt

Robots Exclusion Standard data for helisports.be

Resource Scan

Scan Details

Site Domain helisports.be
Base Domain helisports.be
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-16T13:25:57+00:00
Next Scan 2024-11-17T13:25:57+00:00

Last Successful Scan

Scanned2024-11-02T13:05:07+00:00
URL https://helisports.be/robots.txt
Redirect https://www.helisports.be/robots.txt
Redirect Domain www.helisports.be
Redirect Base helisports.be
Domain IPs 80.69.68.161
Redirect IPs 80.69.68.161
Response IP 80.69.68.161
Found Yes
Hash a3e4020c0ec335e3bfa8bc73c41e631df774ea0b75f7d13a9a4f27ae063dc815
SimHash 9254c11bdd71

Groups

adbeat_bot

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

pricebest

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

webprosbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

thinkchaos

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

elisabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /