ada.org.au
robots.txt

Robots Exclusion Standard data for ada.org.au

Resource Scan

Scan Details

Site Domain ada.org.au
Base Domain ada.org.au
Scan Status Ok
Last Scan2024-09-28T11:42:06+00:00
Next Scan 2024-10-12T11:42:06+00:00

Last Scan

Scanned2024-09-28T11:42:06+00:00
URL https://ada.org.au/robots.txt
Domain IPs 54.253.120.187
Response IP 54.253.120.187
Found Yes
Hash efcfff070bf92d81ea6c3bb45d401d0ca0ff68d33e164d021a2929786153a8c5
SimHash 1b0259326390

Groups

*

Rule Path
Allow /
Disallow /media/
Disallow /umbraco/
Disallow /install/
Disallow /config/
Disallow /scripts/
Disallow /css/
Disallow /email-templates/
Disallow /events_data/
Disallow /placeholders/
Disallow /json/
Disallow /img/
Disallow /BackOfficeElements/

Other Records

Field Value
crawl-delay 10

a6-indexer

Rule Path
Disallow /

abonti

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ada.org.au/sitemap.xml

Warnings

  • 2 invalid lines.