automark.co.za
robots.txt
Robots Exclusion Standard data for automark.co.za
Resource Scan
Scan Details
| Site Domain | automark.co.za |
| Base Domain | automark.co.za |
| Scan Status | Ok |
| Last Scan | 2024-06-26T09:16:58+00:00 |
| Next Scan | 2024-07-26T09:16:58+00:00 |
Last Scan
| Scanned | 2024-06-26T09:16:58+00:00 |
| URL | https://www.automark.co.za/robots.txt |
| Domain IPs | 18.155.68.12, 18.155.68.78, 18.155.68.9, 18.155.68.97, 2600:9000:23d2:2a00:3:6488:7800:93a1, 2600:9000:23d2:3800:3:6488:7800:93a1, 2600:9000:23d2:400:3:6488:7800:93a1, 2600:9000:23d2:4600:3:6488:7800:93a1, 2600:9000:23d2:8a00:3:6488:7800:93a1, 2600:9000:23d2:be00:3:6488:7800:93a1, 2600:9000:23d2:c600:3:6488:7800:93a1, 2600:9000:23d2:e400:3:6488:7800:93a1 |
| Response IP | 18.155.68.9 |
| Found | Yes |
| Hash | 5a26c82b121b1bbf03863333e5dab8a94cfeda2b9cc2ef0e9ab6da470dbe2de4 |
| SimHash | 8109dd096dc2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | */site/* |
| Allow | */enquiry/* |
| Allow | */new-car-variants/* |
| Allow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | |
| Disallow | |
| Disallow | /find-a-dealer |
| Disallow | /secure.adnxs.com |
| Disallow | /find-a-dealer |
| Disallow | |
| Disallow | /www.gforce.co.uk |
| Disallow | /a.tribalfusion.com |
| Allow | */search/* |
| Allow | */vehicle-search/* |
| Allow | */new-car-configurator/* |
| Allow | */data-preferences/* |
Comments