webaware.net.au
robots.txt

Robots Exclusion Standard data for webaware.net.au

Resource Scan

Scan Details

Site Domain webaware.net.au
Base Domain webaware.net.au
Scan Status Ok
Last Scan2025-12-11T18:10:10+00:00
Next Scan 2026-01-10T18:10:10+00:00

Last Scan

Scanned2025-12-11T18:10:10+00:00
URL https://webaware.net.au/robots.txt
Domain IPs 104.21.6.8, 172.67.134.33, 2606:4700:3037::6815:608, 2606:4700:3037::ac43:8621
Response IP 104.21.6.8
Found Yes
Hash dd4640afb21c8ab57da22a1675116eda53a2cae1cd8dc7e75dae943a30f360e5
SimHash 4800da20ab33

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /