connevans.co.uk
robots.txt

Robots Exclusion Standard data for connevans.co.uk

Resource Scan

Scan Details

Site Domain connevans.co.uk
Base Domain connevans.co.uk
Scan Status Ok
Last Scan2025-11-12T22:30:18+00:00
Next Scan 2025-12-12T22:30:18+00:00

Last Scan

Scanned2025-11-12T22:30:18+00:00
URL https://connevans.co.uk/robots.txt
Redirect https://www.connevans.co.uk/robots.txt
Redirect Domain www.connevans.co.uk
Redirect Base connevans.co.uk
Domain IPs 34.240.61.79
Redirect IPs 13.35.37.100, 13.35.37.87, 13.35.37.91, 13.35.37.99, 2600:9000:213e:2400:16:979c:3cc0:93a1, 2600:9000:213e:2800:16:979c:3cc0:93a1, 2600:9000:213e:4e00:16:979c:3cc0:93a1, 2600:9000:213e:6400:16:979c:3cc0:93a1, 2600:9000:213e:8400:16:979c:3cc0:93a1, 2600:9000:213e:b400:16:979c:3cc0:93a1, 2600:9000:213e:c800:16:979c:3cc0:93a1, 2600:9000:213e:ec00:16:979c:3cc0:93a1
Response IP 13.35.37.91
Found Yes
Hash d69e38825ffdae009d935c49f8f4f5a5c32440829a3da08c8f9361475f53d6f2
SimHash 1e35390b6fa3

Groups

*

Rule Path
Disallow /addToBasket.do
Disallow /viewBasket.do
Disallow /productFeedback.form
Disallow /login.form
Disallow /login.new.form
Disallow /viewPage.do?id=high.contrast.chooser
Disallow /newUser.form
Disallow /resetPassword.form
Disallow /registerStockNotification.form
Disallow /logProblem.form
Disallow /viewPage.do?id=advanced-search
Disallow /editDeliveryDetails.form
Disallow /saveBasket.do
Disallow /collectCheckOut.form
Disallow /startPaymentWithPayPal.do
Disallow /startPaymentWithGoogle.do
Disallow /checkOut.form
Disallow /sendBasketToAFriend.form
Disallow /setOrderVAT.do
Disallow /addToResponsiveBasket.do

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /
Disallow /*

baiduspider-image

Rule Path
Disallow /img
Disallow /*

dotbot

Rule Path
Disallow /
Disallow /*

ahrefsbot

Rule Path
Disallow /
Disallow /*

yandexbot

Rule Path
Disallow /
Disallow /*

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /
Disallow /*

facebookexternalhit

Rule Path
Disallow /
Disallow /*

barkrowler

Rule Path
Disallow /
Disallow /*

amazonbot

Rule Path
Disallow /
Disallow /*

petalbot

Rule Path
Disallow /
Disallow /*

oai-searchbot

Rule Path
Disallow /
Disallow /*

chatgpt-user

Rule Path
Disallow /
Disallow /*

gptbot

Rule Path
Disallow /
Disallow /*

blexbot

Rule Path
Disallow /
Disallow /*

barkrowler

Rule Path
Disallow /
Disallow /*

serpstatbot

Rule Path
Disallow /
Disallow /*

friendlycrawler

Rule Path
Disallow /
Disallow /*