dpti.sa.gov.au
robots.txt

Robots Exclusion Standard data for dpti.sa.gov.au

Resource Scan

Scan Details

Site Domain dpti.sa.gov.au
Base Domain dpti.sa.gov.au
Scan Status Ok
Last Scan2024-09-19T22:53:32+00:00
Next Scan 2024-10-03T22:53:32+00:00

Last Scan

Scanned2024-09-19T22:53:32+00:00
URL https://dpti.sa.gov.au/robots.txt
Redirect https://www.dit.sa.gov.au/robots.txt
Redirect Domain www.dit.sa.gov.au
Redirect Base dit.sa.gov.au
Domain IPs 13.33.88.104, 13.33.88.19, 13.33.88.85, 13.33.88.99
Redirect IPs 13.33.88.104, 13.33.88.19, 13.33.88.85, 13.33.88.99
Response IP 13.33.88.99
Found Yes
Hash 5bb8102e30f355ba5d2fc6d61b3f4c770f8a945a9db3b212aacffbae7c80041f
SimHash dc0de442fedb

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /images/
Disallow /search
Disallow /DTEI
Disallow /transport/
Disallow /energy/
Disallow /recboatingfacilities/
Disallow /Southroad/
Disallow /roadsafety/
Disallow /activeforlife/
Disallow /news-media/
Disallow /emergency_contact_details/
Disallow /careers/career_opportunities/media/
Disallow /OutbackRoads/outback_road_warnings_full_google
Disallow /outbackroads/outback_road_warnings_full_google
Disallow /local-government/search
Disallow /communityprograms/search_result
Disallow /infrastructure/search

Warnings

  • 3 invalid lines.