easyfundraising.org.uk
robots.txt

Robots Exclusion Standard data for easyfundraising.org.uk

Resource Scan

Scan Details

Site Domain easyfundraising.org.uk
Base Domain easyfundraising.org.uk
Scan Status Ok
Last Scan2024-06-14T16:51:55+00:00
Next Scan 2024-06-28T16:51:55+00:00

Last Scan

Scanned2024-06-14T16:51:55+00:00
URL https://easyfundraising.org.uk/robots.txt
Redirect https://www.easyfundraising.org.uk/robots.txt
Redirect Domain www.easyfundraising.org.uk
Redirect Base easyfundraising.org.uk
Domain IPs 104.20.61.37, 104.20.62.37, 2606:4700:10::6814:3d25, 2606:4700:10::6814:3e25
Redirect IPs 104.20.61.37, 104.20.62.37, 2606:4700:10::6814:3d25, 2606:4700:10::6814:3e25
Response IP 104.20.62.37
Found Yes
Hash dccd5ccb3f74ce8e058d1a3927fb32bbfd25f6e5e2ff2c1e2d44e6bfc789d907
SimHash 7a14144585a9

Groups

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

cukbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

robots

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

yesupbot

Rule Path
Disallow /

who.is bot

Rule Path
Disallow /

ssearch_bot

Rule Path
Disallow /

mbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

sogou

Rule Path
Disallow /

*

Rule Path
Disallow /login/
Disallow /retailer/*/visit/
Disallow /deal/
Disallow /causes/*/around-the-world/
Disallow /around-the-world/
Disallow /retailer/amazon-smile/
Disallow /feedback/report/
Disallow /blog/tag/
Disallow /causes/*/payments/
Disallow /causes/*/donate/
Disallow /*?*
Allow /

twitterbot

Rule Path
Allow /causes/*/

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.easyfundraising.org.uk/sitemap.xml
sitemap https://www.easyfundraising.org.uk/sitemap-cause.xml
sitemap https://www.easyfundraising.org.uk/sitemap-retailer.xml
sitemap https://www.easyfundraising.org.uk/blog/sitemaps.xml

Comments

  • Naughty List
  • Naughty List end
  • Social media
  • Content sitemap
  • Retailer and Cause sitemaps
  • Blog sitemap