dataweek.co.za
robots.txt
Robots Exclusion Standard data for dataweek.co.za
Resource Scan
Scan Details
| Site Domain | dataweek.co.za |
| Base Domain | dataweek.co.za |
| Scan Status | Ok |
| Last Scan | 2025-08-23T03:00:05+00:00 |
| Next Scan | 2025-09-22T03:00:05+00:00 |
Last Scan
| Scanned | 2025-08-23T03:00:05+00:00 |
| URL | https://dataweek.co.za/robots.txt |
| Redirect | https://www.dataweek.co.za/robots.txt |
| Redirect Domain | www.dataweek.co.za |
| Redirect Base | dataweek.co.za |
| Domain IPs | 104.21.76.107, 172.67.193.17, 2606:4700:3035::6815:4c6b, 2606:4700:3036::ac43:c111 |
| Redirect IPs | 104.21.76.107, 172.67.193.17, 2606:4700:3035::6815:4c6b, 2606:4700:3036::ac43:c111 |
| Response IP | 104.21.76.107 |
| Found | Yes |
| Hash | 2f69907f8c6cef58fffcf0e738e84e995cca024061cc33f48dbee0a147e18bcb |
| SimHash | 01584d0467b6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /digital/* |
| Disallow | /results.aspx |
| Disallow | /results.asp |
| Disallow | /printarticle.aspx |
| Disallow | /printnewsitem.aspx |
| Disallow | /printregular.aspx |
| Disallow | /advert.aspx |
| Disallow | /subscribe.aspx |
| Disallow | /results/results.aspx |
| Disallow | /newsflash/* |
| Disallow | /scroll.aspx |
| Disallow | /scroll.aspX |
| Disallow | /results.aspX |
| Disallow | /webform.aspX |
| Disallow | /webform.aspx |
| Disallow | /webform2.aspx |
| Disallow | /webform2.aspX |
| Disallow | /webForm2.aspx |
| Disallow | /print.aspx |
| Disallow | /cache/ezine-200/ml.html |