motoring.co.za
robots.txt
Robots Exclusion Standard data for motoring.co.za
Resource Scan
Scan Details
| Site Domain | motoring.co.za |
| Base Domain | motoring.co.za |
| Scan Status | Ok |
| Last Scan | 2024-11-09T04:56:40+00:00 |
| Next Scan | 2024-11-16T04:56:40+00:00 |
Last Scan
| Scanned | 2024-11-09T04:56:40+00:00 |
| URL | https://motoring.co.za/robots.txt |
| Domain IPs | 104.21.25.181, 172.67.134.115, 2606:4700:3034::6815:19b5, 2606:4700:3036::ac43:8673 |
| Response IP | 104.21.25.181 |
| Found | Yes |
| Hash | 5fce38735b9f3c5a24d079db6ed19cbfbf5406cf16d5193652af0762c7d1c279 |
| SimHash | c9f61c04fff1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?z= |
| Disallow | *?q= |
| Disallow | */preview/ |
| Disallow | /menu/ |
| Disallow | /menu |
| Disallow | /menu?* |
| Disallow | /print-content* |
| Disallow | /widgets/rss_redirect.php?* |
| Disallow | /index.php?* |
| Disallow | /test$ |
| Disallow | /test1$ |
| Disallow | /test2$ |
| Disallow | /my-notifications |
| Disallow | /my-bookmarks |
| Disallow | /business-report/test$ |
| Disallow | /news/test$ |
| Disallow | /personal-finance/test$ |
| Disallow | /sport/test$ |
| Disallow | /entertainment/test$ |
| Disallow | /lifestyle/test$ |
| Disallow | /travel/test$ |
| Disallow | /motoring/test$ |
| Disallow | /wap.iol.co.za/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.iol.co.za/sitemap.xml |