v2.itweb.co.za
robots.txt
Robots Exclusion Standard data for v2.itweb.co.za
Resource Scan
Scan Details
| Site Domain | v2.itweb.co.za |
| Base Domain | itweb.co.za |
| Scan Status | Ok |
| Last Scan | 2025-10-18T08:46:35+00:00 |
| Next Scan | 2025-10-25T08:46:35+00:00 |
Last Scan
| Scanned | 2025-10-18T08:46:35+00:00 |
| URL | https://v2.itweb.co.za/robots.txt |
| Redirect | https://www.itweb.co.za/robots.txt |
| Redirect Domain | www.itweb.co.za |
| Redirect Base | itweb.co.za |
| Domain IPs | 151.101.1.91 |
| Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 146.75.45.91 |
| Found | Yes |
| Hash | fba2e94c26f3d9419abaa67da2ade90aea2b525199fcc131703c289de3f59950 |
| SimHash | c9119d624d51 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /terms/ |
| Disallow | /api/1.1/terms/ |
| Disallow | *null$ |
| Disallow | *undefined$ |
| Disallow | /mobilesite/ |
| Disallow | |
| Disallow | /*.jfif |
| Disallow | /microsite/ |
| Allow | /microsite/altron |
| Allow | /microsite/ifow |
| Disallow | /event/ |
| Allow | /event/*2025* |
| Allow | /event/*2026* |
| Disallow | /webinar/ |
| Allow | /webinar/*2025* |
| Allow | /webinar/*2026* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.itweb.co.za/sitemap/articles |
| sitemap | https://www.itweb.co.za/sitemap/1/news |