Log In Sign Up

hbf.com.au
robots.txt

Robots Exclusion Standard data for hbf.com.au

Resource Scan

Scan Details

Site Domain hbf.com.au
Base Domain hbf.com.au
Scan Status Ok
Last Scan2024-11-03T18:40:11+00:00
Next Scan 2024-11-17T18:40:11+00:00

Last Scan

Scanned2024-11-03T18:40:11+00:00
URL https://hbf.com.au/robots.txt
Redirect https://www.hbf.com.au/robots.txt
Redirect Domain www.hbf.com.au
Redirect Base hbf.com.au
Domain IPs 13.226.61.54, 13.226.61.57, 13.226.61.63, 13.226.61.70, 2600:9000:21d1:1600:5:1b1:c240:93a1, 2600:9000:21d1:5400:5:1b1:c240:93a1, 2600:9000:21d1:9800:5:1b1:c240:93a1, 2600:9000:21d1:9e00:5:1b1:c240:93a1, 2600:9000:21d1:a000:5:1b1:c240:93a1, 2600:9000:21d1:b000:5:1b1:c240:93a1, 2600:9000:21d1:c200:5:1b1:c240:93a1, 2600:9000:21d1:fa00:5:1b1:c240:93a1
Redirect IPs 13.225.4.125, 13.225.4.40, 13.225.4.50, 13.225.4.58, 2600:9000:21b4:1c00:10:572f:a500:93a1, 2600:9000:21b4:2400:10:572f:a500:93a1, 2600:9000:21b4:4a00:10:572f:a500:93a1, 2600:9000:21b4:5e00:10:572f:a500:93a1, 2600:9000:21b4:6800:10:572f:a500:93a1, 2600:9000:21b4:ce00:10:572f:a500:93a1, 2600:9000:21b4:e400:10:572f:a500:93a1, 2600:9000:21b4:f400:10:572f:a500:93a1
Response IP 13.225.4.40
Found Yes
Hash 3da1f547bfa9b5feae46f6eacc381d8e76bf65b9391cb8aa41e90716e3c71a31
SimHash 1102c8db26b3

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /data
Disallow /*/data/*
Disallow /*/page-data/*
Disallow /*/nav*
Disallow /*/in-page-nav*
Disallow /*/link*
Disallow /*sc_loc*
Disallow /*sc_device*

*

Rule Path
Disallow /use-cover/find-a-provider/results
Disallow /health-insurance/find-a-provider/results
Back to top

Other Records

Field Value
sitemap https://www.hbf.com.au/sitemaps.xml
Back to top

Comments

  • Default Directives
  • Agreement Exclusions
  • Sitemap Reference
Back to top