haloprop.co.za
robots.txt

Robots Exclusion Standard data for haloprop.co.za

Resource Scan

Scan Details

Site Domain haloprop.co.za
Base Domain haloprop.co.za
Scan Status Ok
Last Scan2024-09-07T02:36:27+00:00
Next Scan 2024-10-07T02:36:27+00:00

Last Scan

Scanned2024-09-07T02:36:27+00:00
URL https://haloprop.co.za/robots.txt
Redirect https://www.haloprop.co.za/robots.txt
Redirect Domain www.haloprop.co.za
Redirect Base haloprop.co.za
Domain IPs 107.23.64.217
Redirect IPs 108.156.133.104, 108.156.133.110, 108.156.133.18, 108.156.133.45, 2600:9000:2755:1600:1:67f3:5740:93a1, 2600:9000:2755:1e00:1:67f3:5740:93a1, 2600:9000:2755:2400:1:67f3:5740:93a1, 2600:9000:2755:600:1:67f3:5740:93a1, 2600:9000:2755:6400:1:67f3:5740:93a1, 2600:9000:2755:6c00:1:67f3:5740:93a1, 2600:9000:2755:8200:1:67f3:5740:93a1, 2600:9000:2755:e200:1:67f3:5740:93a1
Response IP 108.156.133.104
Found Yes
Hash cf1f087b89b52092c6f6701e7dbb261653549586d4a490a7fc319bae2c774848
SimHash dd4180148f91

Groups

*

Rule Path
Disallow /secure/
Disallow /sandbox.propdata.net/

trovitbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.haloprop.co.za/residential-for-sale/sitemap.txt
sitemap https://www.haloprop.co.za/commercial-to-let/sitemap.txt
sitemap https://www.haloprop.co.za/industrial-to-let/sitemap.txt
sitemap https://www.haloprop.co.za/areas/sitemap.txt
sitemap https://www.haloprop.co.za/suburbs/sitemap.txt
sitemap https://www.haloprop.co.za/property-types-areas/sitemap.txt
sitemap https://www.haloprop.co.za/property-types-suburbs/sitemap.txt
sitemap https://www.haloprop.co.za/pages/sitemap.txt