renprop.co.za
robots.txt

Robots Exclusion Standard data for renprop.co.za

Resource Scan

Scan Details

Site Domain renprop.co.za
Base Domain renprop.co.za
Scan Status Ok
Last Scan2024-09-07T02:42:17+00:00
Next Scan 2024-10-07T02:42:17+00:00

Last Scan

Scanned2024-09-07T02:42:17+00:00
URL https://renprop.co.za/robots.txt
Redirect https://www.renprop.co.za/robots.txt
Redirect Domain www.renprop.co.za
Redirect Base renprop.co.za
Domain IPs 107.23.64.217
Redirect IPs 108.157.254.60, 108.157.254.63, 108.157.254.91, 108.157.254.96, 2600:9000:2753:5600:e:7e8c:f40:93a1, 2600:9000:2753:6200:e:7e8c:f40:93a1, 2600:9000:2753:8e00:e:7e8c:f40:93a1, 2600:9000:2753:9c00:e:7e8c:f40:93a1, 2600:9000:2753:e400:e:7e8c:f40:93a1, 2600:9000:2753:f600:e:7e8c:f40:93a1, 2600:9000:2753:f800:e:7e8c:f40:93a1, 2600:9000:2753:fc00:e:7e8c:f40:93a1
Response IP 108.157.254.96
Found Yes
Hash b7643e7f97a0d2e1b2be9a42424a489a27a319e0bad92cbaa5a3cdc171c1013f
SimHash d9012f44cdb0

Groups

*

Rule Path
Disallow /secure/
Disallow /sandbox.propdata.net/

trovitbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.renprop.co.za/residential-for-sale/sitemap.txt
sitemap https://www.renprop.co.za/commercial-to-let/sitemap.txt
sitemap https://www.renprop.co.za/industrial-to-let/sitemap.txt
sitemap https://www.renprop.co.za/areas/sitemap.txt
sitemap https://www.renprop.co.za/suburbs/sitemap.txt
sitemap https://www.renprop.co.za/property-types-areas/sitemap.txt
sitemap https://www.renprop.co.za/property-types-suburbs/sitemap.txt
sitemap https://www.renprop.co.za/pages/sitemap.txt
sitemap https://www.renprop.co.za/news/sitemap.txt