www.sira.nsw.gov.au
robots.txt

Robots Exclusion Standard data for www.sira.nsw.gov.au

Resource Scan

Scan Details

Site Domain www.sira.nsw.gov.au
Base Domain nsw.gov.au
Scan Status Ok
Last Scan2025-02-24T06:00:06+00:00
Next Scan 2025-03-26T06:00:06+00:00

Last Scan

Scanned2025-02-24T06:00:06+00:00
URL https://www.sira.nsw.gov.au/robots.txt
Domain IPs 104.18.20.194, 104.18.21.194, 2606:4700::6812:14c2, 2606:4700::6812:15c2
Response IP 104.18.20.194
Found Yes
Hash 5848ff46632e092e5d7b7352133881b5929e6f695895d2d5d66ed4690109fa21
SimHash 7007e000c81b

Groups

funnelback

Rule Path
Disallow /sitemap
Disallow /squiz-sandbox
Disallow /CTP-open-data-iframe
Allow /piawe-elearning

*

Rule Path
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /*_media
Disallow /*_web_services
Disallow /*_nested_content
Disallow /uat
Disallow /integration
Disallow /squiz-sandbox
Disallow /green-slips/data
Disallow /_gspc
Disallow /employerassist/*
Disallow /haveyoubeeninjured/*
Disallow /taxictpinsurance/*
Disallow /homebuildingcompensationdecisionstree/*
Disallow /open-data/_designs/*
Disallow /CTP-open-data-iframe
Disallow *?*query=
Disallow *?*f.*%7C*=
Allow /employerassist/$
Allow /haveyoubeeninjured/$
Allow /taxictpinsurance/$
Allow /homebuildingcompensationdecisionstree/$

Other Records

Field Value
sitemap https://www.sira.nsw.gov.au/sitemap.xml

Comments

  • Site map
  • Disallow Funnelback crawler
  • Disallow other crawlers
  • Prevent bots from crawling FB results

Warnings

  • 9 invalid lines.
  • `<section class="nsw-section" id="in-page-toc" style="display` is not a known field.