businesstech.co.za
robots.txt
Robots Exclusion Standard data for businesstech.co.za
Resource Scan
Scan Details
| Site Domain | businesstech.co.za |
| Base Domain | businesstech.co.za |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-10T19:55:45+00:00 |
| Next Scan | 2024-10-08T19:55:45+00:00 |
Last Successful Scan
| Scanned | 2023-09-10T05:12:44+00:00 |
| URL | https://businesstech.co.za/robots.txt |
| Domain IPs | 104.22.6.40, 104.22.7.40, 172.67.30.91, 2606:4700:10::6816:628, 2606:4700:10::6816:728, 2606:4700:10::ac43:1e5b |
| Response IP | 104.22.7.40 |
| Found | Yes |
| Hash | 9768cb8ad548805d3e990d75dfe8af52e0873d27840ec972514d6072a3d564d3 |
| SimHash | c82cd4a4edd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forum/ |
| Disallow | /news/markets/ |
| Disallow | /news/tech-companies/ |