sira.nsw.gov.au
robots.txt

Robots Exclusion Standard data for sira.nsw.gov.au

Resource Scan

Scan Details

Site Domain sira.nsw.gov.au
Base Domain nsw.gov.au
Scan Status Ok
Last Scan2024-05-30T05:41:24+00:00
Next Scan 2024-06-29T05:41:24+00:00

Last Scan

Scanned2024-05-30T05:41:24+00:00
URL https://sira.nsw.gov.au/robots.txt
Redirect https://www.sira.nsw.gov.au/robots.txt
Redirect Domain www.sira.nsw.gov.au
Redirect Base nsw.gov.au
Domain IPs 43.245.43.52
Redirect IPs 104.18.12.34, 104.18.13.34, 2606:4700::6812:c22, 2606:4700::6812:d22
Response IP 104.18.13.34
Found Yes
Hash a1c1307ced6e4691842d61be23c61219e8cff3e1563edc3a77c3bfbfc9e6fd07
SimHash 7505d100cf91

Groups

funnelback

Rule Path
Disallow /sitemap
Disallow /squiz-sandbox
Disallow /CTP-open-data-iframe
Allow /piawe-elearning

*

Rule Path
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /*_media
Disallow /*_web_services
Disallow /*_nested_content
Disallow /uat
Disallow /integration
Disallow /squiz-sandbox
Disallow /green-slips/data
Disallow /_gspc
Disallow /employerassist/*
Disallow /haveyoubeeninjured/*
Disallow /taxictpinsurance/*
Disallow /homebuildingcompensationdecisionstree/*
Disallow /open-data/_designs/*
Disallow /CTP-open-data-iframe
Disallow *?*query=
Disallow *?*f.*%7C*=
Allow /employerassist/$
Allow /haveyoubeeninjured/$
Allow /taxictpinsurance/$
Allow /homebuildingcompensationdecisionstree/$

Other Records

Field Value
sitemap https://www.sira.nsw.gov.au/sitemap.xml

Comments

  • Site map
  • Disallow Funnelback crawler
  • Disallow other crawlers
  • Prevent bots from crawling FB results