godropship.co.uk
robots.txt

Robots Exclusion Standard data for godropship.co.uk

Resource Scan

Scan Details

Site Domain godropship.co.uk
Base Domain godropship.co.uk
Scan Status Ok
Last Scan2024-09-18T18:31:24+00:00
Next Scan 2024-10-18T18:31:24+00:00

Last Scan

Scanned2024-09-18T18:31:24+00:00
URL https://godropship.co.uk/robots.txt
Redirect https://www.godropship.co.uk/robots.txt
Redirect Domain www.godropship.co.uk
Redirect Base godropship.co.uk
Domain IPs 109.74.201.138
Redirect IPs 109.74.201.138
Response IP 109.74.201.138
Found Yes
Hash 9f668d7a4f1eb90fd259c2ab264d57bafe4d7ab4864fa1ccb8fa480ef85d27db
SimHash f271d7fcc213

Groups

*

Rule Path
Disallow /app/
Disallow /log/
Disallow /cache/
Disallow /uploadfile/
Disallow /template/
Disallow /ssl/

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Disallow /checkout/cart
Disallow /checkout/onepage
Disallow /checkout/confirmOrder
Disallow /customer/account
Disallow /customer/message
Disallow /customer/orders
Disallow /customer/settings
Disallow /customer/address
Disallow /customer/wishlist
Disallow /customer/review
Disallow /customer/recently
Disallow /index.php?appPath=front&appModule=*&appAction=*&order_no=*

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.godropship.co.uk/sitemapproducts.xml
sitemap https://www.godropship.co.uk/sitemapcategories.xml
sitemap https://www.godropship.co.uk/sitemapezpages.xml

Comments

  • SiteLinks20190522