h8.helix-24.biz
robots.txt

Robots Exclusion Standard data for h8.helix-24.biz

Resource Scan

Scan Details

Site Domain h8.helix-24.biz
Base Domain helix-24.biz
Scan Status Ok
Last Scan2024-05-10T13:07:00+00:00
Next Scan 2024-06-09T13:07:00+00:00

Last Scan

Scanned2024-05-10T13:07:00+00:00
URL https://h8.helix-24.biz/robots.txt
Redirect https://h12.helix-24.biz/robots.txt
Redirect Domain h12.helix-24.biz
Redirect Base helix-24.biz
Domain IPs 104.21.69.130, 172.67.208.181, 2606:4700:3036::6815:4582, 2606:4700:3037::ac43:d0b5
Redirect IPs 104.21.69.130, 172.67.208.181, 2606:4700:3036::6815:4582, 2606:4700:3037::ac43:d0b5
Response IP 104.21.69.130
Found Yes
Hash c1d0f691392f77490f957dbe5ca01262c029c14c7d9095b97705d4541c3e5382
SimHash 479e5263cba0

Groups

*

Rule Path
Disallow /find-new/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /admin.php
Disallow /register/
Disallow /lost-password/
Disallow /email-stop/
Disallow /search/
Disallow /members/
Disallow /tags/
Disallow /logout/
Disallow /donate/
Disallow /misc/
Disallow /conversations/
Disallow /online/
Disallow /reports/
Disallow /whats-new/
Disallow /support/
Disallow /watched/
Allow /

yandex

Rule Path
Disallow /find-new/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /admin.php
Disallow /register/
Disallow /lost-password/
Disallow /email-stop/
Disallow /search/
Disallow /members/
Disallow /tags/
Disallow /logout/
Disallow /donate/
Disallow /misc/
Disallow /conversations/
Disallow /online/
Disallow /reports/
Disallow /whats-new/
Disallow /support/
Disallow /watched/

grub-client
grub
looksmart
webzip
larbin
b2w/0.1
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
ia_archiver
ia_archiver/1.6
teleport
teleportpro
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
mozilla/4.0 (compatible; bullseye; windows 95)
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
aqua_products
radiation retriever 1.1
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
olecrawler
mj12bot
wotbox
ahrefsbot
blexbot
bubing
vedma
semrushbot
semrushbot-sa
riddler
curl
guzzlehttp
go-http-client
ccbot
admantx
weborama

Rule Path
Disallow /

Other Records

Field Value
sitemap https://h12.helix-24.biz/sitemap.php

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.