haloprop.co.za
robots.txt
Robots Exclusion Standard data for haloprop.co.za
Resource Scan
Scan Details
Site Domain | haloprop.co.za |
Base Domain | haloprop.co.za |
Scan Status | Ok |
Last Scan | 2024-09-07T02:36:27+00:00 |
Next Scan | 2024-10-07T02:36:27+00:00 |
Last Scan
Scanned | 2024-09-07T02:36:27+00:00 |
URL | https://haloprop.co.za/robots.txt |
Redirect | https://www.haloprop.co.za/robots.txt |
Redirect Domain | www.haloprop.co.za |
Redirect Base | haloprop.co.za |
Domain IPs | 107.23.64.217 |
Redirect IPs | 108.156.133.104, 108.156.133.110, 108.156.133.18, 108.156.133.45, 2600:9000:2755:1600:1:67f3:5740:93a1, 2600:9000:2755:1e00:1:67f3:5740:93a1, 2600:9000:2755:2400:1:67f3:5740:93a1, 2600:9000:2755:600:1:67f3:5740:93a1, 2600:9000:2755:6400:1:67f3:5740:93a1, 2600:9000:2755:6c00:1:67f3:5740:93a1, 2600:9000:2755:8200:1:67f3:5740:93a1, 2600:9000:2755:e200:1:67f3:5740:93a1 |
Response IP | 108.156.133.104 |
Found | Yes |
Hash | cf1f087b89b52092c6f6701e7dbb261653549586d4a490a7fc319bae2c774848 |
SimHash | dd4180148f91 |
Groups
*
Rule | Path |
---|---|
Disallow | /secure/ |
Disallow | /sandbox.propdata.net/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.haloprop.co.za/residential-for-sale/sitemap.txt |
sitemap | https://www.haloprop.co.za/commercial-to-let/sitemap.txt |
sitemap | https://www.haloprop.co.za/industrial-to-let/sitemap.txt |
sitemap | https://www.haloprop.co.za/areas/sitemap.txt |
sitemap | https://www.haloprop.co.za/suburbs/sitemap.txt |
sitemap | https://www.haloprop.co.za/property-types-areas/sitemap.txt |
sitemap | https://www.haloprop.co.za/property-types-suburbs/sitemap.txt |
sitemap | https://www.haloprop.co.za/pages/sitemap.txt |