jameshuntcreates.com.au
robots.txt

Robots Exclusion Standard data for jameshuntcreates.com.au

Resource Scan

Scan Details

Site Domain jameshuntcreates.com.au
Base Domain jameshuntcreates.com.au
Scan Status Ok
Last Scan2025-11-14T14:40:20+00:00
Next Scan 2025-12-14T14:40:20+00:00

Last Scan

Scanned2025-11-14T14:40:20+00:00
URL https://jameshuntcreates.com.au/robots.txt
Domain IPs 104.21.72.241, 172.67.155.233, 2606:4700:3032::6815:48f1, 2606:4700:3033::ac43:9be9
Response IP 104.21.72.241
Found Yes
Hash bfd1e8773465bc6457d1fbf60754b8007cb8026c175652ac0b8be6f2ac7afaaa
SimHash 8d3c5d22e194

Groups

*

Rule Path
Disallow /.github/
Disallow /.phan/
Disallow /assets/
Disallow /backup/
Disallow /bin/
Disallow /cache/
Disallow /logs/
Disallow /system/
Disallow /tests/
Disallow /tmp/
Disallow /user/
Disallow /vendor/
Disallow /webserver-configs/
Allow /user/pages/
Allow /user/themes/
Allow /user/images/
Allow /
Allow *.css$
Allow *.js$
Allow /system/*.js$