mia-moebel.de
robots.txt
Robots Exclusion Standard data for mia-moebel.de
Resource Scan
Scan Details
| Site Domain | mia-moebel.de |
| Base Domain | mia-moebel.de |
| Scan Status | Ok |
| Last Scan | 2024-06-01T23:59:13+00:00 |
| Next Scan | 2024-07-01T23:59:13+00:00 |
Last Scan
| Scanned | 2024-06-01T23:59:13+00:00 |
| URL | https://mia-moebel.de/robots.txt |
| Redirect | https://www.mia-moebel.de/robots.txt |
| Redirect Domain | www.mia-moebel.de |
| Redirect Base | mia-moebel.de |
| Domain IPs | 37.120.182.20 |
| Redirect IPs | 37.120.182.20 |
| Response IP | 37.120.182.20 |
| Found | Yes |
| Hash | c8904bb9ce6d0f18c8c4f7dbc1610bd7f22668b726a19878be4c975831c5bc6b |
| SimHash | 509404569db2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /catalog/category/view |
| Disallow | /catalog/product/gallery |
| Disallow | /catalog/product/view |
| Disallow | /catalog/product_compare |
| Disallow | /catalogsearch |
| Disallow | /checkout/cart |
| Disallow | /checkout/onepage |
| Disallow | /customer |
| Disallow | /erp/checkout |
| Disallow | /erp/index |
| Disallow | /livechat |
| Disallow | /newsletter |
| Disallow | /poll |
| Disallow | /review |
| Disallow | /sendfriend |
| Disallow | /tag |
| Disallow | /wishlist |
| Disallow | /*.htm$ |
| Disallow | /seeya |
jobboersebot
jobroboter
metajobbot
x28-job-bot
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /bewerbung |
| Allow | /jobs |
| Allow | /karriere |
| Disallow | / |
adbeat_bot
ahrefsbot
auskunftbot
baiduspider
barkrowler
beambot
betabot
blexbot
booglebot
botrobin
bspider
bubing
ccbot
coccocbot
daum
domainappender
domainsigmacrawler
domainstatsbot
dotbot
econtext
eeer444
electricmonk
elefent
evc-batch
extlinksbot
finbot
g-i-g-a-b-o-t
garlikcrawler
genieo
gigablast
gigabot
gobyus
heritrix
honeso
houzzbot
httrack
ia_archiver
idealo-bot
implisensebot
istellabot
kocmohabt
linkdexbot
linkedinbot
loocalcrawler
ltx71
mail.ru_bot
mediatoolkitbot
megaindex.ru
memorybot
mj12bot
netestate
netpeakcheckerbot
netseer
nutch
obot
optimizationcrawler
orangebot
pixray-seeker
plukkie
prlog
proximic
psbot
rearchbot
riddler
rogerbot
safednsbot
screaming frog seo spider
search37
searchmetricsbot
semrushbot
seokicks-robot
seoscanners.net
siteexplorer
smtbot
sogou
spbot
surdotlybot
testerbots
thumbsniper
tineye-bot
toplistbot
turnitinbot
uptimebot
vagabondo
vebidoobot
voltron
webintegration
woobot
yoozbot
| Rule | Path |
|---|---|
| Disallow | / |