fireants.org.au
robots.txt

Robots Exclusion Standard data for fireants.org.au

Resource Scan

Scan Details

Site Domain fireants.org.au
Base Domain fireants.org.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-27T13:00:41+00:00
Next Scan 2026-02-26T13:00:41+00:00

Last Successful Scan

Scanned2025-12-06T11:30:59+00:00
URL https://fireants.org.au/robots.txt
Redirect https://www.fireants.org.au/robots.txt
Redirect Domain www.fireants.org.au
Redirect Base fireants.org.au
Domain IPs 43.245.43.13
Redirect IPs 202.9.95.188
Response IP 202.9.95.188
Found Yes
Hash e5d4a821d7e892a6c97bb059192c7b9883bb9ab2e3bd21823e8cbb8b97542e04
SimHash a500e9488d93

Groups

*

Rule Path
Disallow /_designs/
Disallow /squiz-development-area/
Disallow /redirects/
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /*_design
Disallow /*_web_services
Disallow /FACT/national-red-imported-fire-ant-eradication-program

Comments

  • Disallow some matrix defaults
  • Excluding selected pages from crawling so we don't dilute search