zachowek.biz.pl
robots.txt

Robots Exclusion Standard data for zachowek.biz.pl

Resource Scan

Scan Details

Site Domain zachowek.biz.pl
Base Domain zachowek.biz.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-07T13:15:49+00:00
Next Scan 2025-12-07T13:15:49+00:00

Last Successful Scan

Scanned2025-09-15T12:33:14+00:00
URL https://zachowek.biz.pl/robots.txt
Domain IPs 104.21.37.169, 172.67.210.195, 2606:4700:3034::6815:25a9, 2606:4700:3036::ac43:d2c3
Response IP 104.21.37.169
Found Yes
Hash 75307807bd2593fd55d03f8af75a59b4bcdac41994a880a2a7abef4f35bce0c0
SimHash 9001db8203a2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /wp-includes/js/*.js
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow */?s=*
Disallow */feed/
Disallow */feed
Disallow */feed/rss2/
Disallow */feed/rss2
Disallow */?fbclid*