theelectricbikeshop.co.uk
robots.txt

Robots Exclusion Standard data for theelectricbikeshop.co.uk

Resource Scan

Scan Details

Site Domain theelectricbikeshop.co.uk
Base Domain theelectricbikeshop.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-18T19:37:11+00:00
Next Scan 2024-06-17T19:37:11+00:00

Last Successful Scan

Scanned2024-03-27T18:16:33+00:00
URL https://theelectricbikeshop.co.uk/robots.txt
Redirect https://www.theelectricbikeshop.co.uk/robots.txt
Redirect Domain www.theelectricbikeshop.co.uk
Redirect Base theelectricbikeshop.co.uk
Domain IPs 104.26.8.97, 104.26.9.97, 172.67.70.215, 2606:4700:20::681a:861, 2606:4700:20::681a:961, 2606:4700:20::ac43:46d7
Redirect IPs 104.26.8.97, 104.26.9.97, 172.67.70.215, 2606:4700:20::681a:861, 2606:4700:20::681a:961, 2606:4700:20::ac43:46d7
Response IP 104.26.8.97
Found Yes
Hash a2af4b38c689cf7e72ad6e389b38409dc688a77335e045f2a4d6ee44df0a9edc
SimHash 8f5ff965ef19

Groups

googlebot

Rule Path
Disallow /nogooglebot/

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

sogouwebspider

Rule Path
Disallow /

*

Rule Path
Disallow /bin/
Disallow /basket/
Disallow /order/
Disallow /account/
Disallow /login/
Disallow /success/

Other Records

Field Value
sitemap https://www.theelectricbikeshop.co.uk/sitemap.xml

Comments

  • Group 1