aunsec.org
robots.txt

Robots Exclusion Standard data for aunsec.org

Resource Scan

Scan Details

Site Domain aunsec.org
Base Domain aunsec.org
Scan Status Ok
Last Scan2025-09-16T06:26:29+00:00
Next Scan 2025-10-16T06:26:29+00:00

Last Scan

Scanned2025-09-16T06:26:29+00:00
URL https://aunsec.org/robots.txt
Domain IPs 172.104.61.53
Response IP 172.104.61.53
Found Yes
Hash 849a1172c56dc4d6cad8ec14d4b3bcfabf7ec8bb9229c7e480531fffacf557dd
SimHash 6a88100ae4f6

Groups

*

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /ccm/system/captcha/picture

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

bingbot

Rule Path
Disallow /

linkedinbot

Rule Path
Allow /

linebot

Rule Path
Allow /

twitterbot

Rule Path
Disallow /

wechatbot

Rule Path
Allow /

youtube

Rule Path
Allow /

facebookbot

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /