needacar.co.za
robots.txt
Robots Exclusion Standard data for needacar.co.za
Resource Scan
Scan Details
| Site Domain | needacar.co.za |
| Base Domain | needacar.co.za |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-27T22:52:40+00:00 |
| Next Scan | 2025-06-03T22:52:40+00:00 |
Last Successful Scan
| Scanned | 2025-05-19T16:38:24+00:00 |
| URL | https://needacar.co.za/robots.txt |
| Domain IPs | 2a02:4780:84:15f9:306d:525c:5cf8:87c8, 84.32.84.127 |
| Response IP | 191.101.228.196 |
| Found | Yes |
| Hash | a40c3b1a1e179e374112dea756ae7235e04f4fee0d5c5de3ed1b52c2109e089a |
| SimHash | 2fc459166996 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /temp/ |
| Disallow | /db_backup/ |
| Disallow | /periodic.php |
| Disallow | /favorites.php |
| Disallow | /feed.php |
| Disallow | /login.php |
| Disallow | /logout.php |
| Disallow | /mailto.php |
| Disallow | /reply.php |
| Disallow | /report.php |
| Disallow | /access_restricted.php |
| Disallow | /not_authorized.php |
| Disallow | /offline.php |