byhandel.com
robots.txt
Robots Exclusion Standard data for byhandel.com
Resource Scan
Scan Details
| Site Domain | byhandel.com |
| Base Domain | byhandel.com |
| Scan Status | Ok |
| Last Scan | 2025-03-31T21:40:44+00:00 |
| Next Scan | 2025-04-14T21:40:44+00:00 |
Last Scan
| Scanned | 2025-03-31T21:40:44+00:00 |
| URL | https://byhandel.com/robots.txt |
| Domain IPs | 104.21.87.219, 172.67.147.5, 2606:4700:3032::6815:57db, 2606:4700:3033::ac43:9305 |
| Response IP | 104.21.87.219 |
| Found | Yes |
| Hash | 9b02789cdde925dbf24c0031e221c52b5d96e4fc29d3cca76baf69de4d5b5c1a |
| SimHash | 519e52f3cdb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
microsoft url control
naver
dittospyder
webzip
ahrefsbot
gigabot
webauto
urly warning
larbin
cherrypickerelite/1.0
linkwalker
mozilla/4.0 (compatible; msie 4.0; windows xp)
asterias
enterprise_search
rma
stanford
tocrawl/urldispatcher
stanford spiderboys
mozilla/5
wget/1.6
teoma
copyrightcheck
webmasterworldforumbot
cherrypicker
moget/2.1
webvac
mozilla/4.0 (compatible; msie 4.0; windows nt)
blowfish/1.0
jennybot
repomonkey
lwp-trivial
ia_archiver/1.6
http://www.webmasterworld.com bot
enterprise_search/1.0
mozilla/4.0 (compatible; msie 4.0; windows 2000)
wget/1.5.3
openbot
miixpc/4.2
szukacz/1.4
semrushbot
propowerbot/2.14
emailcollector
searchpreview
perman
nutch
prowebwalker
fairad client
mj12bot
backdoorbot/1.0
libweb/clshttp
webcopier
becomebot
webbandit
sootle
mozilla/4.0 (compatible; msie 4.0; windows 95)
alexibot
oracle ultra search
suzuran
teleportpro
nicerspro
rogerbot
lnspiderguy
mozilla/4
crescent internet toolpak http ole control v.1.0
looksmart
queryn metasearch
emailsiphon
netants
spankbot
bullseye/1.0
blexbot
mister pix
the intraformant
webbandit/3.50
stanford comp sci
jetbot/1.0
webster pro
gaisbot
infonavirobot
netmechanic
cherrypickerse/1.0
aqua_products
radiation retriever 1.1
web image collector
url_spider_pro
openfind
blekkobot
msiecrawler
repomonkey bait & tackle/v1.01
vci webviewer vci webviewer win32
zeus
jetbot
sitesnagger
cosmos
webzip/4.0
grub
true_robot/1.0
cheesebot
scooter
websauger
stanford compclub
bookmark search tool
exabot
erocrawler
crescent
miixpc
openfind data gathere
stanford compsciclub
iron33/1.0.2
builtbottough
es
hloader
psbot
botalot
linkextractorpro
telesoft
thenomad
www-collector-e
humanlinks
website quester
mata hari
bunnyslippers
lexibot
true_robot
microsoft url control - 5.01.4511
foobot
xenu's link sleuth 1.1c
dumbot
webenhancer
offline explorer
webstripper
mozilla
emailwolf
vci
mozilla/3
zeus link scout
harvest/1.5
httplib
mozilla
url control
teleport
http://www.searchengineworld.com bot
lwp-trivial/1.34
wget
getright/4.2
zeus 32297 webster pro v2.9 win32
xenu's
dotbot
mozilla/4.0 (compatible; bullseye; windows 95)
flaming attackbot
moget
copernic
kenjin spider
hatena antenna
python-urllib
mozilla/4.0 (compatible; msie 4.0; windows 98)
webmasterworld extractor
turingos
keyword density/0.9
extractorpro
ia_archiver
microsoft url control - 6.00.8169
linkscan/8.1a unix
spanner
b2w/0.1
grub-client
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://byhandel.com/sitemap_index.xml |
| sitemap | http://byhandel.com/sitemap_index.xml |
Comments