hackerspunk.com
robots.txt

Robots Exclusion Standard data for hackerspunk.com

Resource Scan

Scan Details

Site Domain hackerspunk.com
Base Domain hackerspunk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-01T12:08:16+00:00
Next Scan 2025-10-30T12:08:16+00:00

Last Successful Scan

Scanned2023-07-14T05:28:24+00:00
URL https://hackerspunk.com/robots.txt
Redirect https://www.hackerspunk.com/robots.txt
Redirect Domain www.hackerspunk.com
Redirect Base hackerspunk.com
Domain IPs 104.21.2.160, 172.67.129.95, 2606:4700:3031::ac43:815f, 2606:4700:3036::6815:2a0
Redirect IPs 104.21.2.160, 172.67.129.95, 2606:4700:3031::ac43:815f, 2606:4700:3036::6815:2a0
Response IP 104.21.2.160
Found Yes
Hash 811f043220d133c08b5c0a5169a6093ee1078649d6419a98fb040953332f661f
SimHash 490596704fd3

Groups

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.hackerspunk.com/atom.xml?redirect=false&start-index=1&max-results=500