primelocation.com
robots.txt

Robots Exclusion Standard data for primelocation.com

Resource Scan

Scan Details

Site Domain primelocation.com
Base Domain primelocation.com
Scan Status Ok
Last Scan2025-05-17T19:37:25+00:00
Next Scan 2025-05-24T19:37:25+00:00

Last Scan

Scanned2025-05-17T19:37:25+00:00
URL https://primelocation.com/robots.txt
Redirect https://www.primelocation.com/robots.txt
Redirect Domain www.primelocation.com
Redirect Base primelocation.com
Domain IPs 108.128.68.122, 176.34.105.207, 34.254.2.66
Redirect IPs 104.18.12.158, 104.18.13.158, 2606:4700::6812:c9e, 2606:4700::6812:d9e
Response IP 104.18.12.158
Found Yes
Hash 4cbbf4c7b8e20dfc5506962ca2e9895177dd121f01c62087130c5489b8578093
SimHash 22548b5caeb5

Groups

*

Rule Path
Disallow */sort.html*
Disallow /*?st=EORST*
Disallow /comparison-api/*
Disallow /*/details/map/*
Disallow */details/print/
Disallow */details/photos/
Disallow */stations/
Disallow */local-info/
Disallow /datafeed
Disallow /widgets
Disallow /graph
Disallow /ajax
Disallow /dynimgs
Disallow /cgi-bin
Disallow /violation
Disallow /xmlfeed
Disallow /myaccount
Disallow /ze
Disallow /*/contact
Disallow /askme/rating/*
Disallow /*radius%3D
Disallow /tracking/
Disallow /*?rpn=*
Disallow /*?qpn=
Disallow /downloads
Disallow /*5765/ZPG/*
Disallow /*9215/ZPG/*
Disallow /property/values/compare/*
Disallow */report-content/*
Disallow /find-agents/missing/
Disallow /property/incorrect/
Disallow /find-agents/error/
Disallow /trustedtradesmen
Disallow /tips
Disallow */add/
Disallow /friend/
Disallow /rockandroll
Disallow /iheartlondon
Disallow /*.pdf$
Disallow /search/
Disallow /signin*
Disallow /useful-tools/
Disallow /myzoopla/
Disallow /*/edit/*
Disallow /property/estimate/
Disallow /property/claim/
Disallow /appraisal/
Disallow /property-history/
Disallow /property-history2/
Disallow /to-rent/fees/*
Disallow /to-rent/offices/*
Disallow /?rc-input-council_tax_band=
Disallow /for-sale/houses/auction/*
Disallow /for-sale/flats/auction/*
Disallow /for-sale/retirement/auction/*
Disallow /for-sale/bungalows/auction/*
Disallow /for-sale/farms-land/auction/*
Disallow /invest/?*show_variations=*
Disallow /save-on-your-energy-bills/
Disallow /moving/services/
Disallow /finance/ssi/*
Disallow /broadband/*
Disallow /home-values/check-postcode.html
Disallow /property/track/*
Disallow */static/svg/ui*
Disallow /*new_homes%3D
Disallow /*q%3D
Disallow /*?identifier=
Disallow /*%26identifier%3D
Disallow /*url%3D
Disallow */map/
Disallow /*seo_is_keyword
Disallow /*keywords%3D
Disallow /*play_movie%3D
Disallow /*image%3D
Disallow /*rc-input-council_tax_band%3D
Disallow /*feature%3D
Disallow /property/
Disallow /property/uprn/
Disallow /cdn-cgi/
Disallow /*search_source%3Dfacets
Disallow /*include_sold%3D
Disallow /*business_for_sale%3D
Disallow /*search-path%3D
Disallow /home-values/*/
Disallow /new-homes/flats/studio/*/
Disallow /new-homes/retirement/*/
Allow /new-homes/retirement/uk/
Disallow /for-sale/farms-land/*-bedroom
Disallow /for-sale/farms-land/studio
Disallow /plus/buy/?referer=*
Disallow /plus/buy/*/?referer=*
Disallow /api/*
Disallow /for-sale2/*
Disallow /property2/*
Disallow /for-rent2/*
Disallow /new-homes2/*
Disallow /vulnerability-disclosure

baiduspider

Rule Path
Disallow /to-rent/
Disallow /home-values/
Disallow /house-prices/
Disallow /find-agents/
Disallow /market/
Disallow /property/
Disallow /askme/

slurp

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

spriftcrawler

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

cbbot

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

spider

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

verity/1.1

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.primelocation.com/xmlsitemap/agents_comm_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_comm_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_comm_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_comm_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_est_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_est_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_est_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_est_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_let_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_let_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_let_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_let_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_oversea_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/agents_oversea_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/commerce_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/commerce_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/commerce_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/commerce_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/commerce_index_5.xml
sitemap https://www.primelocation.com/xmlsitemap/forsale_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/forsale_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/forsale_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/forsale_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/forsale_index_5.xml
sitemap https://www.primelocation.com/xmlsitemap/houseprice_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/houseprice_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/houseprice_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/houseprice_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_dev_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_dev_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_dev_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_dev_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/newhomes_index_5.xml
sitemap https://www.primelocation.com/xmlsitemap/overseas_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/overseas_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/torent_index_1.xml
sitemap https://www.primelocation.com/xmlsitemap/torent_index_2.xml
sitemap https://www.primelocation.com/xmlsitemap/torent_index_3.xml
sitemap https://www.primelocation.com/xmlsitemap/torent_index_4.xml
sitemap https://www.primelocation.com/xmlsitemap/torent_index_5.xml

Comments

  • . .....
  • .Z$$$$77I??+.
  • .I$$$$$77+I?++~:~~.
  • .$$$$. . .~~~~.
  • .$$$. .,7II?=.. .~==.
  • .$$$. =777I+~::~, ..==+
  • .$$$=. 7777. .~~~~ ~??I.
  • .$77 I77. .~~~ II7.
  • .777 I7I~ .~~,. 77$
  • .77I III? .~~~.. $$$.
  • 7II III?+.. ..==== .$$Z
  • .II ?II?++======+ Z$$.
  • .7I ?I?~++++++?.. .$$Z7.
  • .= ???~ .7$$ZZ.
  • +???= I$Z$$$..
  • .??II77$$$$$$Z..
  • ..?$$$$$+..
  • Disallow: /property/location/edit/*
  • Disallow: /property/edit/
  • Baidu restricted to for sale and new homes
  • Slurp (Still slurping why?)
  • Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
  • blocked as they are making incorrect requests
  • Let Google Ads crawl everything
  • let grapeshot crawl all pages
  • Petalbot blocked as they are making a huge number of requests