dzienna.pl
robots.txt

Robots Exclusion Standard data for dzienna.pl

Resource Scan

Scan Details

Site Domain dzienna.pl
Base Domain dzienna.pl
Scan Status Ok
Last Scan5/26/2025, 9:27:47 PM
Next Scan 6/2/2025, 9:27:47 PM

Last Scan

Scanned5/26/2025, 9:27:47 PM
URL https://dzienna.pl/robots.txt
Domain IPs 104.21.68.90, 172.67.192.185, 2606:4700:3032::6815:445a, 2606:4700:3037::ac43:c0b9
Response IP 104.21.68.90
Found Yes
Hash f32d440a86dd391baa3017b5f8e3d182e215a2dc819f04ebb8d4d0ce97a6d08f
SimHash 3d1d9c82e18a

Groups

mj12bot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /rsscache/
Disallow /phpseclib/
Disallow /psd/
Disallow /instalator/
Disallow /panel/
Disallow /tmp/
Disallow /ustawienia/

Other Records

Field Value
crawl-delay 60