pwr.co.za
robots.txt

Robots Exclusion Standard data for pwr.co.za

Resource Scan

Scan Details

Site Domain pwr.co.za
Base Domain pwr.co.za
Scan Status Ok
Last Scan2024-09-08T01:20:27+00:00
Next Scan 2024-10-08T01:20:27+00:00

Last Scan

Scanned2024-09-08T01:20:27+00:00
URL https://pwr.co.za/robots.txt
Redirect https://www.pwr.co.za/robots.txt
Redirect Domain www.pwr.co.za
Redirect Base pwr.co.za
Domain IPs 107.23.64.217
Redirect IPs 13.33.88.110, 13.33.88.27, 13.33.88.28, 13.33.88.48, 2600:9000:223b:200:5:a6e3:4140:93a1, 2600:9000:223b:2a00:5:a6e3:4140:93a1, 2600:9000:223b:4c00:5:a6e3:4140:93a1, 2600:9000:223b:4e00:5:a6e3:4140:93a1, 2600:9000:223b:5400:5:a6e3:4140:93a1, 2600:9000:223b:9000:5:a6e3:4140:93a1, 2600:9000:223b:b000:5:a6e3:4140:93a1, 2600:9000:223b:f400:5:a6e3:4140:93a1
Response IP 13.33.88.110
Found Yes
Hash c665fbcf7fb2ed7f8593ffa9ada6fb651fcbaed6f4e543376f16fd6ab23866a7
SimHash 58506867cf11

Groups

*

Rule Path
Disallow /secure/
Disallow /sandbox.propdata.net/

trovitbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.pwr.co.za/residential-for-sale/sitemap.txt
sitemap https://www.pwr.co.za/commercial-to-let/sitemap.txt
sitemap https://www.pwr.co.za/industrial-to-let/sitemap.txt
sitemap https://www.pwr.co.za/areas/sitemap.txt
sitemap https://www.pwr.co.za/suburbs/sitemap.txt
sitemap https://www.pwr.co.za/property-types-areas/sitemap.txt
sitemap https://www.pwr.co.za/property-types-suburbs/sitemap.txt
sitemap https://www.pwr.co.za/pages/sitemap.txt
sitemap https://www.pwr.co.za/news/sitemap.txt