stdavids.co.za
robots.txt

Robots Exclusion Standard data for stdavids.co.za

Resource Scan

Scan Details

Site Domain stdavids.co.za
Base Domain stdavids.co.za
Scan Status Ok
Last Scan2025-10-10T05:52:15+00:00
Next Scan 2025-11-09T05:52:15+00:00

Last Scan

Scanned2025-10-10T05:52:15+00:00
URL https://stdavids.co.za/robots.txt
Redirect https://www.stdavids.co.za/robots.txt
Redirect Domain www.stdavids.co.za
Redirect Base stdavids.co.za
Domain IPs 95.217.27.190
Redirect IPs 195.201.228.118
Response IP 195.201.228.118
Found Yes
Hash 2bce230269827ae3081db82974552dbe1858666b41c1871b94169c35b24680c3
SimHash 091083568ba3

Groups

*

Rule Path
Disallow /craft/

Comments

  • Don't allow web crawlers to index Craft