Log In Sign Up

realcommercial.com.au
robots.txt

Robots Exclusion Standard data for realcommercial.com.au

Resource Scan

Scan Details

Site Domain realcommercial.com.au
Base Domain realcommercial.com.au
Scan Status Ok
Last Scan2024-09-14T01:18:55+00:00
Next Scan 2024-09-21T01:18:55+00:00

Last Scan

Scanned2024-09-14T01:18:55+00:00
URL https://realcommercial.com.au/robots.txt
Redirect https://www.realcommercial.com.au/robots.txt
Redirect Domain www.realcommercial.com.au
Redirect Base realcommercial.com.au
Domain IPs 23.50.86.161, 2600:1413:1:3a0::3413, 2600:1413:1:3b1::3413
Redirect IPs 23.50.86.161, 2600:1413:1:990::3413
Response IP 104.69.168.168
Found Yes
Hash 76d9938a6c9bf5d42e341df7ad4e64707ea0d908396c69b1abcb9ec0bcac9638
SimHash bc11451345c5

Groups

*

Rule Path
Disallow /building/example

yakazbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.realcommercial.com.au/news/xml-sitemap/news-sitemap.xml
sitemap https://www.realcommercial.com.au/news/xml-sitemap/news-sitemap.xml
sitemap https://www.realcommercial.com.au/xml-sitemap/pdp-sitemap.xml.gz
sitemap https://www.realcommercial.com.au/xml-sitemap/srp-sitemap.xml.gz
Back to top

Comments

  • In accessing or using any REA Group Website you agree that you will not use any automated device,
  • software, process or means to access, retrieve, scrape, or index any REA Group Website or any
  • content on any REA Group Website. Notwithstanding the foregoing, REA Group may permit automated
  • access to certain REA Group Website pages strictly for the purpose of including content in publicly
  • available general search engines. This does not include any such access by websites that
  • specifically aggregate property listings and/or information as part of their business. REA Group
  • strictly prohibits any automated access by these types of websites.
Back to top