penguin.co.nz
robots.txt

Robots Exclusion Standard data for penguin.co.nz

Resource Scan

Scan Details

Site Domain penguin.co.nz
Base Domain penguin.co.nz
Scan Status Ok
Last Scan2024-10-07T01:41:21+00:00
Next Scan 2024-11-06T01:41:21+00:00

Last Scan

Scanned2024-10-07T01:41:21+00:00
URL https://penguin.co.nz/robots.txt
Redirect https://www.penguin.co.nz:443/robots.txt
Redirect Domain www.penguin.co.nz
Redirect Base penguin.co.nz
Domain IPs 108.156.133.12, 108.156.133.41, 108.156.133.89, 108.156.133.99
Redirect IPs 13.238.16.168, 3.104.32.140, 52.63.127.196
Response IP 52.63.127.196
Found Yes
Hash 072d7f25e620b61b54d45568d61a35bcfc55ff83eee6a317d08648ade4c06d29
SimHash e858d922e292

Groups

*

Rule Path
Disallow /media/q2022rr2nd0/
Allow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /