anmfsa.org.au
robots.txt

Robots Exclusion Standard data for anmfsa.org.au

Resource Scan

Scan Details

Site Domain anmfsa.org.au
Base Domain anmfsa.org.au
Scan Status Ok
Last Scan2025-11-18T17:11:55+00:00
Next Scan 2025-12-18T17:11:55+00:00

Last Scan

Scanned2025-11-18T17:11:55+00:00
URL https://anmfsa.org.au/robots.txt
Domain IPs 104.16.130.63
Response IP 104.16.130.63
Found Yes
Hash f105a300f0463ebdcc245295f30a1fbad2c9cb025502ed7739d72b1a4830a88a
SimHash 0918b986ee72

Groups

*

Rule Path
Disallow /OpenSearch.aspx
Disallow /OptOut.aspx
Disallow /Sitemap.aspx
Disallow /App_Browsers/
Disallow /App_Data/
Disallow /AsiCommon/
Disallow /bin/
Disallow /Core/
Disallow /iMISDBUpgrade/
Disallow /iParts/
Disallow /Old_App_Code/
Disallow /Web/Archive/
Disallow /RadControls/
Disallow /iMisService
Disallow /imisservice/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /