niepoddawajsie.pl
robots.txt

Robots Exclusion Standard data for niepoddawajsie.pl

Resource Scan

Scan Details

Site Domain niepoddawajsie.pl
Base Domain niepoddawajsie.pl
Scan Status Ok
Last Scan2025-11-24T17:01:16+00:00
Next Scan 2025-12-01T17:01:16+00:00

Last Scan

Scanned2025-11-24T17:01:16+00:00
URL https://niepoddawajsie.pl/robots.txt
Domain IPs 138.199.46.68, 2400:52e0:1500::868:1
Response IP 138.199.24.219
Found Yes
Hash 3aa3793e3efd041ae6e864958f367291e0b8ac6481c17702019bdb44b1df3957
SimHash 49010a0a2736

Groups

scrapy

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /t/
Disallow /f/
Disallow /fak/
Disallow /st/
Disallow /dz/
Disallow /pr/
Disallow /k/
Disallow /ft/
Disallow /ko/
Disallow /l/
Disallow /p/
Disallow /k/
Disallow /o/

Other Records

Field Value
sitemap https://www.niepoddawajsie.pl/sitemap_index.xml