rjcox.com.au
robots.txt

Robots Exclusion Standard data for rjcox.com.au

Resource Scan

Scan Details

Site Domain rjcox.com.au
Base Domain rjcox.com.au
Scan Status Ok
Last Scan2025-11-02T11:53:00+00:00
Next Scan 2025-12-02T11:53:00+00:00

Last Scan

Scanned2025-11-02T11:53:00+00:00
URL https://www.rjcox.com.au/robots.txt
Domain IPs 104.21.78.48, 172.67.216.151, 2606:4700:3031::6815:4e30, 2606:4700:3031::ac43:d897
Response IP 172.67.216.151
Found Yes
Hash 32be0193e4118ce266cc4dd0cab21add6c56609249a0977490b9c9096a38a2dd
SimHash 7905f8a05391

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /404.asp
Disallow /500.asp
Disallow /zippay.asp

*

Rule Path
Disallow /register.asp

*

Rule Path
Disallow /login.asp

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

petalbot

Rule Path
Disallow /