bimago.pl
robots.txt

Robots Exclusion Standard data for bimago.pl

Resource Scan

Scan Details

Site Domain bimago.pl
Base Domain bimago.pl
Scan Status Ok
Last Scan2024-09-17T04:16:26+00:00
Next Scan 2024-10-17T04:16:26+00:00

Last Scan

Scanned2024-09-17T04:16:26+00:00
URL https://bimago.pl/robots.txt
Redirect https://www.bimago.pl/robots.txt
Redirect Domain www.bimago.pl
Redirect Base bimago.pl
Domain IPs 108.157.254.111, 108.157.254.125, 108.157.254.19, 108.157.254.70, 2600:9000:2753:1c00:15:a8a0:9040:93a1, 2600:9000:2753:2a00:15:a8a0:9040:93a1, 2600:9000:2753:4200:15:a8a0:9040:93a1, 2600:9000:2753:5000:15:a8a0:9040:93a1, 2600:9000:2753:6600:15:a8a0:9040:93a1, 2600:9000:2753:7000:15:a8a0:9040:93a1, 2600:9000:2753:8400:15:a8a0:9040:93a1, 2600:9000:2753:9200:15:a8a0:9040:93a1
Redirect IPs 18.155.68.20, 18.155.68.6, 18.155.68.8, 18.155.68.9, 2600:9000:23d2:200:2:f78b:ea40:93a1, 2600:9000:23d2:3800:2:f78b:ea40:93a1, 2600:9000:23d2:9000:2:f78b:ea40:93a1, 2600:9000:23d2:9c00:2:f78b:ea40:93a1, 2600:9000:23d2:b200:2:f78b:ea40:93a1, 2600:9000:23d2:bc00:2:f78b:ea40:93a1, 2600:9000:23d2:d200:2:f78b:ea40:93a1, 2600:9000:23d2:f200:2:f78b:ea40:93a1
Response IP 18.155.68.9
Found Yes
Hash cc8f139066d2f2d37860662fba7aaee6934c9c9ef9b57da43b0de776574aebe3
SimHash b09f58cb8ef5

Groups

*

Rule Path
Disallow /customer/account/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /wishlist/
Disallow /search/
Disallow /*SID%3D
Disallow /moje-ulubione.html

Other Records

Field Value
crawl-delay 5

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bimago.pl/sitemap.xml