pnuk.co
robots.txt

Robots Exclusion Standard data for pnuk.co

Resource Scan

Scan Details

Site Domain pnuk.co
Base Domain pnuk.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/20/2025, 4:15:58 AM
Next Scan 5/21/2025, 4:15:58 AM

Last Successful Scan

Scanned5/13/2025, 2:56:01 AM
URL https://pnuk.co/robots.txt
Redirect https://z1exp.com/robots.txt
Redirect Domain z1exp.com
Redirect Base z1exp.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 138.68.174.179
Response IP 138.68.174.179
Found Yes
Hash 1bbe19f061c0692fe0d3edaad707cc2a5dbb61833b5deb44bcdf4dbdbc1c368c
SimHash 730c82a2f335

Groups

*

Rule Path
Disallow /private/
Allow /public/

psbot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

java

Rule Path
Disallow /

httrack off-line browser

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /infiniterss*

mediapartners-google*

Rule Path
Disallow