carglass.se
robots.txt
Robots Exclusion Standard data for carglass.se
Resource Scan
Scan Details
| Site Domain | carglass.se |
| Base Domain | carglass.se |
| Scan Status | Ok |
| Last Scan | 2024-09-25T04:59:19+00:00 |
| Next Scan | 2024-10-25T04:59:19+00:00 |
Last Scan
| Scanned | 2024-09-25T04:59:19+00:00 |
| URL | https://carglass.se/robots.txt |
| Redirect | https://www.carglass.se/robots.txt |
| Redirect Domain | www.carglass.se |
| Redirect Base | carglass.se |
| Domain IPs | 104.198.14.52 |
| Redirect IPs | 18.139.194.139, 2406:da18:880:3801::c8, 2406:da18:b3d:e201::64, 46.137.195.11 |
| Response IP | 13.215.144.61 |
| Found | Yes |
| Hash | 67f3ce8502ebbf66cdbe9ea425c11b6789e85a50945a8919a102ff64f42946c6 |
| SimHash | 519f52c3c9c4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /portal* |
| Disallow | /*vrn* |
| Disallow | /*bvstate* |
| Disallow | /*yoReviewsPage* |
| Disallow | /*stepName* |
| Disallow | /*place* |
| Disallow | /*damage* |
| Disallow | /*location* |
mj12bot
ia_archiver
atspider
b2w/0.1
becomebot
cheesebot
cherrypicker
copyrightcheck
copernic
crescent
dsurf
dumbot
elitesys entry
emailcollector
emailsiphon
emailwolf
enterprise_search/1.0
enterprise_search
es
extractorpro
flaming attackbot
freefind
grub
grub-client
hatena antenna
jetbot
jetbot/1.0
larbin
mail sweeper
munky
naver
netmechanic
nutch
omniexplorer_bot
oracle ultra search
perman
prowebwalker
psbot
python-urllib
radiation retriever 1.1
roverbot
searchpreview
sitesnagger
sootle
stanford
url_spider_pro
webbandit
webemailextrac
webvac
webzip
xget
wget
webwalk
webvac
webreaper
webmirror
webfetcher
webcopy
webcopier
webcatcher
webbandit
w3mir
vobsub
templeton
ssearcher100
spiderbot
shai'hulud
pbwf
lightningdownload
kdd exploror
jeeves
internet explore
infospiders
httrack
havindex
geturl
getbot
esirover
download wonder
collage
lnspiderguy
alexibot
teleport
teleportpro
stanford comp sci
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
| Rule | Path |
|---|---|
| Disallow | / |