localstore.co.za
robots.txt

Robots Exclusion Standard data for localstore.co.za

Resource Scan

Scan Details

Site Domain localstore.co.za
Base Domain localstore.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/16/2025, 3:40:09 AM
Next Scan 7/15/2025, 3:40:09 AM

Last Successful Scan

Scanned6/21/2024, 3:26:34 AM
URL https://localstore.co.za/robots.txt
Redirect https://www.localstore.co.za/robots.txt
Redirect Domain www.localstore.co.za
Redirect Base localstore.co.za
Domain IPs 104.26.12.156, 104.26.13.156, 172.67.69.165, 2606:4700:20::681a:c9c, 2606:4700:20::681a:d9c, 2606:4700:20::ac43:45a5
Redirect IPs 104.26.12.156, 104.26.13.156, 172.67.69.165, 2606:4700:20::681a:c9c, 2606:4700:20::681a:d9c, 2606:4700:20::ac43:45a5
Response IP 104.26.12.156
Found Yes
Hash 180234312e3503e0fc6447b8a5a32e2da669326631c640a953aa26efd5fb0ac9
SimHash c214f8c54003

Groups

mediapartners-google

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /about/
Disallow /admin/
Disallow /brand/search/
Disallow /contact/
Disallow /content/
Disallow /cms-directory/
Disallow /cms-directory-store/
Disallow /cms-offer/
Disallow /cms-staff/
Disallow /feedback/
Disallow /g/
Disallow /gallery/*/*/*/report/
Disallow /near/
Disallow /review/
Disallow /search/
Disallow /server/
Disallow /soft-admin/
Disallow /stores/search/
Disallow /suggest/
Disallow /update/