businesstechafrica.co.za
robots.txt
Robots Exclusion Standard data for businesstechafrica.co.za
Resource Scan
Scan Details
| Site Domain | businesstechafrica.co.za |
| Base Domain | businesstechafrica.co.za |
| Scan Status | Ok |
| Last Scan | 2024-09-06T16:35:35+00:00 |
| Next Scan | 2024-10-06T16:35:35+00:00 |
Last Scan
| Scanned | 2024-09-06T16:35:35+00:00 |
| URL | https://businesstechafrica.co.za/robots.txt |
| Domain IPs | 192.250.229.45 |
| Response IP | 192.250.229.45 |
| Found | Yes |
| Hash | 72d8d5a68d7ea241bc34560c223f035a6c20087a6b46d94c72bd5e977455a34f |
| SimHash | 0d340cc0b017 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /flipboardrss/ |
| Disallow | /wp-login.php |
| Disallow | /wp-trackback.php |
| Disallow | /advertising.php |
| Disallow | /privacy.php |
| Disallow | /news.php |
| Disallow | /xmlrpc.php |
| Disallow | /downloads/ |
| Disallow | /cvx/client/sync/fpc |
| Disallow | /*.js |
| Disallow | /*.js$ |
| Disallow | /? |
| Disallow | *?z= |
| Disallow | *?q= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.businesstechafrica.co.za/sitemap_index.xml |
| sitemap | https://www.businesstechafrica.co.za/news-sitemap.xml |
Comments