Log In Sign Up

bimago.nl
robots.txt

Robots Exclusion Standard data for bimago.nl

Resource Scan

Scan Details

Site Domain bimago.nl
Base Domain bimago.nl
Scan Status Ok
Last Scan2024-08-27T03:41:07+00:00
Next Scan 2024-09-26T03:41:07+00:00

Last Scan

Scanned2024-08-27T03:41:07+00:00
URL https://bimago.nl/robots.txt
Redirect https://www.bimago.nl/robots.txt
Redirect Domain www.bimago.nl
Redirect Base bimago.nl
Domain IPs 13.33.88.102, 13.33.88.122, 13.33.88.14, 13.33.88.65, 2600:9000:223b:4400:15:a8a0:9040:93a1, 2600:9000:223b:5000:15:a8a0:9040:93a1, 2600:9000:223b:7a00:15:a8a0:9040:93a1, 2600:9000:223b:8400:15:a8a0:9040:93a1, 2600:9000:223b:b600:15:a8a0:9040:93a1, 2600:9000:223b:d000:15:a8a0:9040:93a1, 2600:9000:223b:ec00:15:a8a0:9040:93a1, 2600:9000:223b:ee00:15:a8a0:9040:93a1
Redirect IPs 13.33.183.45, 13.33.183.73, 13.33.183.81, 13.33.183.82, 2600:9000:2003:1400:17:3c76:8700:93a1, 2600:9000:2003:3600:17:3c76:8700:93a1, 2600:9000:2003:7200:17:3c76:8700:93a1, 2600:9000:2003:7400:17:3c76:8700:93a1, 2600:9000:2003:8000:17:3c76:8700:93a1, 2600:9000:2003:b000:17:3c76:8700:93a1, 2600:9000:2003:b400:17:3c76:8700:93a1, 2600:9000:2003:c000:17:3c76:8700:93a1
Response IP 52.84.229.45
Found Yes
Hash a2898f8fb7c68d021ea0169c3b477cf1f1013ccfd1e7fb2d66468c2a9debd587
SimHash a09b58cbcef5

Groups

*

Rule Path
Disallow /customer/account/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /wishlist/
Disallow /search/
Disallow /*SID%3D
Disallow /klembord.html

Other Records

Field Value
crawl-delay 5

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bimago.nl/sitemap.xml
Back to top