naidion.com
robots.txt
Robots Exclusion Standard data for naidion.com
Resource Scan
Scan Details
| Site Domain | naidion.com |
| Base Domain | naidion.com |
| Scan Status | Ok |
| Last Scan | 2025-08-27T04:11:56+00:00 |
| Next Scan | 2025-09-26T04:11:56+00:00 |
Last Scan
| Scanned | 2025-08-27T04:11:56+00:00 |
| URL | https://naidion.com/robots.txt |
| Redirect | http://www.naidion.com/robots.txt |
| Redirect Domain | www.naidion.com |
| Redirect Base | naidion.com |
| Domain IPs | 104.21.37.13, 172.67.202.103, 2606:4700:3033::6815:250d, 2606:4700:3035::ac43:ca67 |
| Redirect IPs | 104.21.37.13, 172.67.202.103, 2606:4700:3033::6815:250d, 2606:4700:3035::ac43:ca67 |
| Response IP | 172.67.202.103 |
| Found | Yes |
| Hash | 40b50616155063185fb7d2063dd75630faa0570e029d137849eb7558dd7c4f3b |
| SimHash | 279ed2e74187 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /genImage.php |
| Disallow | /iframe.php?grandparent |
| Disallow | /997 |
| Disallow | /search.php |
| Disallow | /popup.php |
| Disallow | /216 |
| Disallow | /resources/userdata/images/accommodations/ |
| Disallow | /partner |
| Disallow | /external |
| Disallow | /webservices |
| Disallow | /search_simple.php |
| Disallow | /150/simple_search |
| Disallow | /150/full_search |
| Disallow | /acc_search |
| Disallow | /admin |
| Disallow | /184 |
| Disallow | /218 |
| Disallow | /248 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
websitewiki
eurobot
accoona-ai-agent/1.1.2
henrythemiragorobot
gonzo1
gonzo2
gonzo1p
gonzo2p
seekbot
mqbot
cpase kdabot
scooter/3.3
voyager/1.0
grub-client
grub-client-2.3
grub
looksmart
krugle
webzip
larbin
b2w/0.1
psbot
ichiro/2.0
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
sproose
webrankspider/1.37
gpuse
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
teleport
teleportpro
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
jetbot
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
aqua_products
radiation retriever 1.1
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
fast enterprise crawler
gigabot/2.0
gigabot/3.0
gigabot
sogou pic spider
gazz/5.0
turnitinbot/2.0
ichiro/1.0
converacrawler/0.4
mj12bot
twiceler.
twiceler
heinrichdermiragorobot
ia_archiver
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /genImage.php |
| Disallow | /iframe.php?grandparent |
| Disallow | /997 |
| Disallow | /search.php |
| Disallow | /popup.php |
| Disallow | /216 |
| Disallow | /resources/userdata/images/accommodations/ |
| Disallow | /partner |
| Disallow | /external |
| Disallow | /webservices |
| Disallow | /search_simple.php |
| Disallow | /150/simple_search |
| Disallow | /150/full_search |
| Disallow | /acc_search |
| Disallow | /admin |
| Disallow | /184 |
| Disallow | /218 |
| Disallow | /248 |