zoopla.co.uk
robots.txt

Robots Exclusion Standard data for zoopla.co.uk

Resource Scan

Scan Details

Site Domain zoopla.co.uk
Base Domain zoopla.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T23:57:47+00:00
Next Scan 2024-11-20T23:57:47+00:00

Last Successful Scan

Scanned2023-01-23T14:14:45+00:00
URL https://zoopla.co.uk/robots.txt
Redirect https://www.zoopla.co.uk/robots.txt
Redirect Domain www.zoopla.co.uk
Redirect Base zoopla.co.uk
Domain IPs 108.129.38.104, 34.255.236.254, 52.48.233.205
Redirect IPs 108.129.38.104, 34.255.236.254, 52.48.233.205
Response IP 34.255.236.254
Found Yes
Hash c329d41b687380ad7e1ca46e8cd8477e2e0cf426cb51773abc0c287cc04c0d9d
SimHash e25c115daf74

Groups

*

Rule Path
Disallow */sort.html*
Disallow /*?st=EORST*
Disallow /comparison-api/*
Disallow /*/details/map/*
Disallow */details/print/
Disallow */details/photos/
Disallow */stations/
Disallow */local-info/
Disallow /datafeed
Disallow /widgets
Disallow /graph
Disallow /ajax
Disallow /dynimgs
Disallow /cgi-bin
Disallow /violation
Disallow /xmlfeed
Disallow /myaccount
Disallow /ze
Disallow /*/contact
Disallow /askme/rating/*
Disallow /*radius%3D
Disallow /tracking/
Disallow /*?rpn=*
Disallow /*?qpn=
Disallow /downloads
Disallow /*5765/ZPG/*
Disallow /*9215/ZPG/*
Disallow /property/values/compare/*
Disallow */report-content/*
Disallow /find-agents/missing/
Disallow /property/incorrect/
Disallow /find-agents/error/
Disallow /trustedtradesmen
Disallow /tips
Disallow */add/
Disallow /friend/
Disallow /rockandroll
Disallow /iheartlondon
Disallow /*.pdf$
Disallow /search/
Disallow /signin*
Disallow /useful-tools/
Disallow /myzoopla/
Disallow /*/edit/*
Disallow /property/estimate/
Disallow /property/claim/
Disallow /appraisal/
Disallow /property-history/
Disallow /to-rent/fees/*
Disallow /to-rent/offices/*
Disallow /?rc-input-council_tax_band=
Disallow /for-sale/houses/auction/*
Disallow /for-sale/flats/auction/*
Disallow /for-sale/retirement/auction/*
Disallow /for-sale/bungalows/auction/*
Disallow /for-sale/farms-land/auction/*
Disallow /invest/?*show_variations=*
Disallow /save-on-your-energy-bills/
Disallow /moving/services/
Disallow /finance/ssi/*
Disallow /broadband/*
Disallow /home-values/check-postcode.html
Disallow /property/track/*
Disallow */static/svg/ui*
Disallow /*new_homes%3D
Disallow /*q%3D
Disallow /*?identifier=
Disallow /*%26identifier%3D
Disallow /*url%3D
Disallow */map/
Disallow /*seo_is_keyword
Disallow /*keywords%3D
Disallow /*play_movie%3D
Disallow /*image%3D
Disallow /*rc-input-council_tax_band%3D
Disallow /*feature%3D
Disallow /property/
Disallow /property/uprn/
Disallow /*?search_identifier

baiduspider

Rule Path
Disallow /to-rent/
Disallow /home-values/
Disallow /house-prices/
Disallow /find-agents/
Disallow /market/
Disallow /property/
Disallow /askme/

slurp

Rule Path
Disallow /

proximic

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.zoopla.co.uk/xmlsitemap/sitemap/index.xml.gz
sitemap https://www.zoopla.co.uk/xmlsitemap/manual_sitemap/commercial_srp_sitemap.txt.gz
sitemap https://www.zoopla.co.uk/xmlsitemap/manual_sitemap/overseas_srp_sitemap.txt.gz

Comments

  • ___ ___ ___ ___ ___
  • / /\ / /\ / /\ / /\ / /\
  • / /::| / /::\ / /::\ / /::\ / /::\
  • / /:/:| / /:/\:\ / /:/\:\ / /:/\:\ ___ ___ / /:/\:\
  • / /:/|:|__ / /:/ \:\ / /:/ \:\ / /:/~/:/ /__/\ / /\ / /:/~/::\
  • /__/:/ |:| /\ /__/:/ \__\:\ /__/:/ \__\:\ /__/:/ /:/ \ \:\ / /:/ /__/:/ /:/\:\
  • \__\/ |:|/:/ \ \:\ / /:/ \ \:\ / /:/ \ \:\/:/ \ \:\ /:/ \ \:\/:/__\/
  • | |:/:/ \ \:\ /:/ \ \:\ /:/ \ \::/ \ \:\/:/ \ \::/
  • | |::/ \ \:\/:/ \ \:\/:/ \ \:\ \ \::/ \ \:\
  • | |:/ \ \::/ \ \::/ \ \:\ \__\/ \ \:\
  • |__|/ \__\/ \__\/ \__\/ \__\/
  • Disallow: /property/location/edit/*
  • Disallow: /property/edit/
  • Baidu restricted to for sale and new homes
  • Slurp (Still slurping why?)
  • Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
  • blocked as they are making incorrect requests
  • Let Google Ads crawl everything
  • let grapeshot crawl all pages
  • Petalbot blocked as they are making a huge number of requests