Log In Sign Up

bimago.co.uk
robots.txt

Robots Exclusion Standard data for bimago.co.uk

Resource Scan

Scan Details

Site Domain bimago.co.uk
Base Domain bimago.co.uk
Scan Status Ok
Last Scan2024-09-17T04:46:07+00:00
Next Scan 2024-10-17T04:46:07+00:00

Last Scan

Scanned2024-09-17T04:46:07+00:00
URL https://bimago.co.uk/robots.txt
Redirect https://www.bimago.co.uk/robots.txt
Redirect Domain www.bimago.co.uk
Redirect Base bimago.co.uk
Domain IPs 108.157.254.111, 108.157.254.125, 108.157.254.19, 108.157.254.70, 2600:9000:2753:1a00:15:a8a0:9040:93a1, 2600:9000:2753:4600:15:a8a0:9040:93a1, 2600:9000:2753:6a00:15:a8a0:9040:93a1, 2600:9000:2753:6c00:15:a8a0:9040:93a1, 2600:9000:2753:8800:15:a8a0:9040:93a1, 2600:9000:2753:a000:15:a8a0:9040:93a1, 2600:9000:2753:a400:15:a8a0:9040:93a1, 2600:9000:2753:e400:15:a8a0:9040:93a1
Redirect IPs 13.227.254.30, 13.227.254.34, 13.227.254.35, 13.227.254.90, 2600:9000:200a:5200:17:f0c2:500:93a1, 2600:9000:200a:600:17:f0c2:500:93a1, 2600:9000:200a:8000:17:f0c2:500:93a1, 2600:9000:200a:8c00:17:f0c2:500:93a1, 2600:9000:200a:9600:17:f0c2:500:93a1, 2600:9000:200a:a600:17:f0c2:500:93a1, 2600:9000:200a:a800:17:f0c2:500:93a1, 2600:9000:200a:d600:17:f0c2:500:93a1
Response IP 13.227.254.30
Found Yes
Hash 77e73bc8bb577fefdd2815037cd2d9ddcc00af80a93f0d89424c2283f07e0f7c
SimHash a0df78498ef7

Groups

*

Rule Path
Disallow /customer/account/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /wishlist/
Disallow /search/
Disallow /*SID%3D
Disallow /stash.html

Other Records

Field Value
crawl-delay 5

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bimago.co.uk/sitemap.xml
Back to top