themotorist.co.za
robots.txt
Robots Exclusion Standard data for themotorist.co.za
Resource Scan
Scan Details
| Site Domain | themotorist.co.za |
| Base Domain | themotorist.co.za |
| Scan Status | Ok |
| Last Scan | 2025-05-10T23:16:56+00:00 |
| Next Scan | 2025-06-09T23:16:56+00:00 |
Last Scan
| Scanned | 2025-05-10T23:16:56+00:00 |
| URL | https://themotorist.co.za/robots.txt |
| Redirect | https://n1truckspares.co.za/robots.txt |
| Redirect Domain | n1truckspares.co.za |
| Redirect Base | n1truckspares.co.za |
| Domain IPs | 104.21.24.109, 172.67.218.87, 2606:4700:3031::6815:186d, 2606:4700:3033::ac43:da57 |
| Redirect IPs | 104.21.15.120, 172.67.162.151, 2606:4700:3032::ac43:a297, 2606:4700:3033::6815:f78 |
| Response IP | 172.67.162.151 |
| Found | Yes |
| Hash | a5585e77673eeed5fdc1791e4cb71521d798a4ad2687be4a109077f09d9909ed |
| SimHash | 29140ad28713 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /discover/ |
| Disallow | /convert/ |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://redrockrecovery.co.za/sitemap.xml |