accesscanberra.act.gov.au
robots.txt

Robots Exclusion Standard data for accesscanberra.act.gov.au

Resource Scan

Scan Details

Site Domain accesscanberra.act.gov.au
Base Domain act.gov.au
Scan Status Ok
Last Scan2026-02-01T01:46:17+00:00
Next Scan 2026-02-15T01:46:17+00:00

Last Scan

Scanned2026-02-01T01:46:17+00:00
URL https://accesscanberra.act.gov.au/robots.txt
Redirect https://www.accesscanberra.act.gov.au/robots.txt
Redirect Domain www.accesscanberra.act.gov.au
Redirect Base act.gov.au
Domain IPs 2.58.104.10, 2.58.104.11
Redirect IPs 2.58.104.10, 2.58.104.11
Response IP 2.58.104.10
Found Yes
Hash 37420c8e326e74a57f9511fb6d6fa4980d6e9e1afe485f7056a2faa9737c6ba0
SimHash 754579b0ec83

Groups

*

Rule Path
Disallow /search
Disallow /design
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /_performance
Disallow /_designs/
Disallow /*_design
Disallow /*_web_services
Disallow /__lib
Disallow /__fudge
Disallow /_media

Other Records

Field Value
crawl-delay 20

funnelback

Rule Path
Disallow *?*query=
Disallow *?*f.*%7C*=

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap /sitemap.xml
sitemap https://www.accesscanberra.act.gov.au/sitemap.xml

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/
  • Prevent crawling of Funnelback search queries or facets.