bimago.de
robots.txt

Robots Exclusion Standard data for bimago.de

Resource Scan

Scan Details

Site Domain bimago.de
Base Domain bimago.de
Scan Status Ok
Last Scan2024-09-17T04:40:36+00:00
Next Scan 2024-10-17T04:40:36+00:00

Last Scan

Scanned2024-09-17T04:40:36+00:00
URL https://bimago.de/robots.txt
Redirect https://www.bimago.de/robots.txt
Redirect Domain www.bimago.de
Redirect Base bimago.de
Domain IPs 108.157.254.111, 108.157.254.125, 108.157.254.19, 108.157.254.70, 2600:9000:2753:3a00:15:a8a0:9040:93a1, 2600:9000:2753:5200:15:a8a0:9040:93a1, 2600:9000:2753:8800:15:a8a0:9040:93a1, 2600:9000:2753:c200:15:a8a0:9040:93a1, 2600:9000:2753:ca00:15:a8a0:9040:93a1, 2600:9000:2753:e00:15:a8a0:9040:93a1, 2600:9000:2753:f000:15:a8a0:9040:93a1, 2600:9000:2753:fe00:15:a8a0:9040:93a1
Redirect IPs 13.35.18.11, 13.35.18.116, 13.35.18.124, 13.35.18.34, 2600:9000:20c7:1e00:1b:90cf:2100:93a1, 2600:9000:20c7:2600:1b:90cf:2100:93a1, 2600:9000:20c7:2800:1b:90cf:2100:93a1, 2600:9000:20c7:5c00:1b:90cf:2100:93a1, 2600:9000:20c7:6c00:1b:90cf:2100:93a1, 2600:9000:20c7:6e00:1b:90cf:2100:93a1, 2600:9000:20c7:7600:1b:90cf:2100:93a1, 2600:9000:20c7:c400:1b:90cf:2100:93a1
Response IP 13.35.18.34
Found Yes
Hash 903530dded202d77f6efb068876e1f86ff139947ce5db69048503074b6d76b8a
SimHash b09f58c9cef7

Groups

*

Rule Path
Disallow /customer/account/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /wishlist/
Disallow /search/
Disallow /*SID%3D
Disallow /meine-wunschliste.html

Other Records

Field Value
crawl-delay 5

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bimago.de/sitemap.xml