bimago.es
robots.txt

Robots Exclusion Standard data for bimago.es

Resource Scan

Scan Details

Site Domain bimago.es
Base Domain bimago.es
Scan Status Ok
Last Scan2024-05-25T02:11:42+00:00
Next Scan 2024-06-24T02:11:42+00:00

Last Scan

Scanned2024-05-25T02:11:42+00:00
URL https://bimago.es/robots.txt
Redirect https://www.bimago.es/robots.txt
Redirect Domain www.bimago.es
Redirect Base bimago.es
Domain IPs 108.157.254.111, 108.157.254.125, 108.157.254.19, 108.157.254.70, 2600:9000:2753:4e00:15:a8a0:9040:93a1, 2600:9000:2753:6200:15:a8a0:9040:93a1, 2600:9000:2753:7c00:15:a8a0:9040:93a1, 2600:9000:2753:b400:15:a8a0:9040:93a1, 2600:9000:2753:b800:15:a8a0:9040:93a1, 2600:9000:2753:be00:15:a8a0:9040:93a1, 2600:9000:2753:c800:15:a8a0:9040:93a1, 2600:9000:2753:fc00:15:a8a0:9040:93a1
Redirect IPs 108.156.133.115, 108.156.133.23, 108.156.133.39, 108.156.133.81, 2600:9000:2755:0:5:ed36:68c0:93a1, 2600:9000:2755:1000:5:ed36:68c0:93a1, 2600:9000:2755:1800:5:ed36:68c0:93a1, 2600:9000:2755:2600:5:ed36:68c0:93a1, 2600:9000:2755:5e00:5:ed36:68c0:93a1, 2600:9000:2755:6400:5:ed36:68c0:93a1, 2600:9000:2755:8000:5:ed36:68c0:93a1, 2600:9000:2755:d200:5:ed36:68c0:93a1
Response IP 108.156.133.23
Found Yes
Hash c3c5cadc8801a3ffce7ba6a586cf2ce587976f1f9dd3987eb0a650e862df40e5
SimHash b19f79cbceb3

Groups

*

Rule Path
Disallow /customer/account/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /wishlist/
Disallow /search/
Disallow /*SID%3D
Disallow /mis-favoritos.html

Other Records

Field Value
crawl-delay 5

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bimago.es/sitemap.xml