links.z1exp.com
robots.txt

Robots Exclusion Standard data for links.z1exp.com

Resource Scan

Scan Details

Site Domain links.z1exp.com
Base Domain z1exp.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-01-29T04:04:14+00:00
Next Scan 2025-04-29T04:04:14+00:00

Last Successful Scan

Scanned2024-09-09T04:01:11+00:00
URL https://links.z1exp.com/robots.txt
Redirect https://pnuk.com/robots.txt
Redirect Domain pnuk.com
Redirect Base pnuk.com
Domain IPs 104.21.96.123, 172.67.180.16, 2606:4700:3034::ac43:b410, 2606:4700:3037::6815:607b
Redirect IPs 104.21.20.238, 172.67.194.221, 2606:4700:3034::6815:14ee, 2606:4700:3036::ac43:c2dd
Response IP 172.67.194.221
Found Yes
Hash 1bbe19f061c0692fe0d3edaad707cc2a5dbb61833b5deb44bcdf4dbdbc1c368c
SimHash 730c82a2f335

Groups

*

Rule Path
Disallow /private/
Allow /public/

psbot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

java

Rule Path
Disallow /

httrack off-line browser

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /infiniterss*

mediapartners-google*

Rule Path
Disallow