chiropracticaustralia.org.au
robots.txt

Robots Exclusion Standard data for chiropracticaustralia.org.au

Resource Scan

Scan Details

Site Domain chiropracticaustralia.org.au
Base Domain chiropracticaustralia.org.au
Scan Status Ok
Last Scan2024-09-17T04:38:12+00:00
Next Scan 2024-10-17T04:38:12+00:00

Last Scan

Scanned2024-09-17T04:38:12+00:00
URL https://www.chiropracticaustralia.org.au/robots.txt
Domain IPs 2600:9000:2003:0:f:679c:af00:93a1, 2600:9000:2003:200:f:679c:af00:93a1, 2600:9000:2003:4600:f:679c:af00:93a1, 2600:9000:2003:6600:f:679c:af00:93a1, 2600:9000:2003:7600:f:679c:af00:93a1, 2600:9000:2003:de00:f:679c:af00:93a1, 2600:9000:2003:ec00:f:679c:af00:93a1, 2600:9000:2003:f200:f:679c:af00:93a1, 52.84.229.10, 52.84.229.45, 52.84.229.50, 52.84.229.53
Response IP 52.84.229.45
Found Yes
Hash b4c2624f7e507891ec8cd5e08f2c2834a4ad63e1f9a0b08dfce3177f20813698
SimHash 415459d1c7e4

Groups

*

Rule Path Comment
Disallow /* Disallow everything
Allow /public/*/website/favicon.ico -

googlebot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

powermapper

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

Comments

  • Allow favicon.ico with wildcard for directory segment