Log In Sign Up

realestate.co.nz
robots.txt

Robots Exclusion Standard data for realestate.co.nz

Resource Scan

Scan Details

Site Domain realestate.co.nz
Base Domain realestate.co.nz
Scan Status Ok
Last Scan2024-06-28T16:51:21+00:00
Next Scan 2024-07-05T16:51:21+00:00

Last Scan

Scanned2024-06-28T16:51:21+00:00
URL https://realestate.co.nz/robots.txt
Redirect https://www.realestate.co.nz/robots.txt
Redirect Domain www.realestate.co.nz
Redirect Base realestate.co.nz
Domain IPs 13.35.18.122, 13.35.18.32, 13.35.18.56, 13.35.18.57, 2600:9000:20c7:200:5:2757:6180:93a1, 2600:9000:20c7:3200:5:2757:6180:93a1, 2600:9000:20c7:4a00:5:2757:6180:93a1, 2600:9000:20c7:5e00:5:2757:6180:93a1, 2600:9000:20c7:6a00:5:2757:6180:93a1, 2600:9000:20c7:b000:5:2757:6180:93a1, 2600:9000:20c7:ca00:5:2757:6180:93a1, 2600:9000:20c7:ec00:5:2757:6180:93a1
Redirect IPs 13.35.18.122, 13.35.18.32, 13.35.18.56, 13.35.18.57, 2600:9000:20c7:200:5:2757:6180:93a1, 2600:9000:20c7:4200:5:2757:6180:93a1, 2600:9000:20c7:6400:5:2757:6180:93a1, 2600:9000:20c7:a00:5:2757:6180:93a1, 2600:9000:20c7:b000:5:2757:6180:93a1, 2600:9000:20c7:c00:5:2757:6180:93a1, 2600:9000:20c7:ce00:5:2757:6180:93a1, 2600:9000:20c7:d800:5:2757:6180:93a1
Response IP 13.35.18.56
Found Yes
Hash 5196257399b4c0829fab93bab2e53f58d4a3d2d596f117f456178dd2fc2de661
SimHash 8986c4d2d1d5

Groups

yakazbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

cbbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

proximic

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

caribot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

googlebot-news

Rule Path
Disallow /blog/agents/

*

Rule Path
Disallow /account
Disallow /account/my-property
Disallow /account/my-searches
Disallow /account/my-open-homes
Disallow /account/saved-searches
Disallow /account/saved-properties
Disallow /account/notifications
Disallow /mock-listing
Disallow /learn-to-minimise-a-listing
Disallow /listings
Disallow /*?*hsa_mt=
Disallow /*?*hsa_cam=
Disallow /*?*hsa_kw=
Disallow /*?*hsa_net=
Disallow /*?*hsa_src=
Disallow /*?*hsa_mt=
Disallow /*?*hsa_acc=
Disallow /*?*hsa_mt=
Disallow /*?*hsa_ad=
Disallow /*?*hsa_tgt=
Disallow /*?*hsa_ver=
Disallow /*?*_hsenc=
Disallow /*?*_hsmi=
Disallow /*/statistics
Disallow /*/email
Disallow /redirect
Disallow /*/pdf
Back to top

Other Records

Field Value
sitemap https://www.realestate.co.nz/sitemap.xml
Back to top

Comments

  • _ _ _
  • | | | | | |
  • _ __ ___ __ _| | ___ ___| |_ __ _| |_ ___ ___ ___ _ __ ____
  • | '__/ _ \/ _` | |/ _ \/ __| __/ _` | __/ _ \ / __/ _ \ | '_ \|_ /
  • | | | __/ (_| | | __/\__ \ || (_| | || __/| (_| (_) || | | |/ /
  • |_| \___|\__,_|_|\___||___/\__\__,_|\__\___(_)___\___(_)_| |_/___|
  • In accessing or using any Realestate.co.nz Website you agree that you will not use any automated device,
  • software, process or means to access, retrieve, scrape, or index any Realestate.co.nz Website or any
  • content on any Realestate.co.nz Website. Notwithstanding the foregoing, Realestate.co.nz may permit automated
  • access to certain Realestate.co.nz Website pages strictly for the purpose of including content in publicly
  • available general search engines. This does not include any such access by websites that
  • specifically aggregate property listings and/or information as part of their business.
  • Realestate.co.nz strictly prohibits any automated access by these types of websites.
  • block the bad bots
  • Let Google Ads crawl everything
  • Keep our news out of actual news
  • everyone else
  • account pages
  • mock listing
  • relative image from fastboot/shoebox
  • Blocking HubSpot/DSA parameters
  • listing stats
  • share a listing
  • redirection
  • listing pdfs
Back to top

Warnings

  • 2 invalid lines.
Back to top