dit.sa.gov.au
robots.txt
Robots Exclusion Standard data for dit.sa.gov.au
Resource Scan
Scan Details
| Site Domain | dit.sa.gov.au |
| Base Domain | dit.sa.gov.au |
| Scan Status | Ok |
| Last Scan | 2024-05-27T21:48:31+00:00 |
| Next Scan | 2024-06-10T21:48:31+00:00 |
Last Scan
| Scanned | 2024-05-27T21:48:31+00:00 |
| URL | https://dit.sa.gov.au/robots.txt |
| Domain IPs | 13.33.88.104, 13.33.88.19, 13.33.88.85, 13.33.88.99 |
| Response IP | 13.33.88.104 |
| Found | Yes |
| Hash | 01ee543c46b012eb91cc0fd0c3f4d51510d49018c127c0bd85f32d44876ce8a9 |
| SimHash | 98196442ded3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /images/ |
| Disallow | /DTEI |
| Disallow | /transport/ |
| Disallow | /energy/ |
| Disallow | /recboatingfacilities/ |
| Disallow | /Southroad/ |
| Disallow | /roadsafety/ |
| Disallow | /activeforlife/ |
| Disallow | /news-media/ |
| Disallow | /emergency_contact_details/ |
| Disallow | /careers/career_opportunities/media/ |
| Disallow | /OutbackRoads/outback_road_warnings_full_google |
| Disallow | /outbackroads/outback_road_warnings_full_google |
Warnings
- 3 invalid lines.