mctwize.co.za
robots.txt
Robots Exclusion Standard data for mctwize.co.za
Resource Scan
Scan Details
| Site Domain | mctwize.co.za |
| Base Domain | mctwize.co.za |
| Scan Status | Ok |
| Last Scan | 2026-03-15T22:45:20+00:00 |
| Next Scan | 2026-04-14T22:45:20+00:00 |
Last Scan
| Scanned | 2026-03-15T22:45:20+00:00 |
| URL | https://mctwize.co.za/robots.txt |
| Redirect | https://studentcompanion.co.za/robots.txt |
| Redirect Domain | studentcompanion.co.za |
| Redirect Base | studentcompanion.co.za |
| Domain IPs | 104.21.47.183, 172.67.171.205, 2606:4700:3030::ac43:abcd, 2606:4700:3035::6815:2fb7 |
| Redirect IPs | 104.21.22.141, 172.67.205.31, 2606:4700:3030::ac43:cd1f, 2606:4700:3035::6815:168d |
| Response IP | 172.67.205.31 |
| Found | Yes |
| Hash | 6ffe1bb0ce5002acbade2a3a296f734d60c14d58aa9fec7839994abc909743a1 |
| SimHash | 2b0d8d720bf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /download* |
| Disallow | /index.php/download* |
| Disallow | /search* |
| Disallow | /auth/login |
| Disallow | /me/playlists |
| Disallow | /me/stats |
| Disallow | /me/upload |
| Disallow | /playlist* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://studentcompanion.co.za/sitemap.xml |