donedeal.co.uk
robots.txt

Robots Exclusion Standard data for donedeal.co.uk

Resource Scan

Scan Details

Site Domain donedeal.co.uk
Base Domain donedeal.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T06:24:23+00:00
Next Scan 2024-11-13T06:24:23+00:00

Last Successful Scan

Scanned2024-07-17T06:22:58+00:00
URL https://donedeal.co.uk/robots.txt
Redirect https://www.donedeal.co.uk/robots.txt
Redirect Domain www.donedeal.co.uk
Redirect Base donedeal.co.uk
Domain IPs 104.22.46.64, 104.22.47.64, 172.67.27.198, 2606:4700:10::6816:2e40, 2606:4700:10::6816:2f40, 2606:4700:10::ac43:1bc6
Redirect IPs 104.22.46.64, 104.22.47.64, 172.67.27.198, 2606:4700:10::6816:2e40, 2606:4700:10::6816:2f40, 2606:4700:10::ac43:1bc6
Response IP 104.22.47.64
Found Yes
Hash 26ec1cff06fbd6d0cecd31ae53efccbcc00ff1aba3d8efec1655e702403a4f5e
SimHash 7b99c855f3fb

Groups

*

Rule Path
Disallow /donedeal/support/contact.jsp
Disallow /donedeal/publish/
Disallow /donedeal/update/
Disallow /donedeal/remove/
Disallow /donedeal/pay/
Disallow /donedeal/contact
Disallow /donedeal/subscription
Disallow /donedeal/voucher
Disallow /donedeal/campaign
Disallow /remove
Disallow /donedeal/ajax/
Disallow /donedeal/ajax/addToSavedAds
Disallow /donedeal/classifieds/viewFullPhoto
Disallow /adwrite/publish/
Disallow /adwrite/update/
Disallow /adwrite/remove/
Disallow /adwrite/pay/
Disallow /adwrite/payment/
Disallow /adwrite/contact/
Disallow /adwrite/subscription/
Disallow /adwrite/report/
Disallow /accounts/
Disallow /remove/
Disallow /update/
Disallow /bump/
Disallow *?userId
Disallow /history-check/

oodlebot

Rule Path
Disallow /

donkiz

Rule Path
Disallow /

donkizbot

Rule Path
Disallow /

sightupbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

ooyyo network

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

Comments

  • added 22/09/2009
  • added 9/4/2011 by Fred (trying to block Donkiz, but not sure if this works)
  • added 23/05/2011 by Declan (trying to block Sightup)
  • added 16/10/2014 by Pete
  • added 20/02/2015 by Pete
  • added 16/09/2016 by Pete
  • added 07/10/2021