scrapujemy.pl
robots.txt
Robots Exclusion Standard data for scrapujemy.pl
Resource Scan
Scan Details
| Site Domain | scrapujemy.pl |
| Base Domain | scrapujemy.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-10-07T05:04:58+00:00 |
| Next Scan | 2026-01-05T05:04:58+00:00 |
Last Successful Scan
| Scanned | 2022-08-23T01:02:37+00:00 |
| URL | https://scrapujemy.pl/robots.txt |
| Response IP | 172.67.132.43 |
| Found | Yes |
| Hash | fbf768417e015a1a389f44272927bc772ac00a03d335ae61878b568c809f1e5d |
| SimHash | 110557405597 |
Groups
*
| Rule | Path |
|---|---|
| Allow | * |
| Disallow | /images/ |
| Disallow | /js/ |
| Disallow | /products/ |
| Disallow | /css/ |
| Disallow | /about.html |
| Disallow | /contact.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://scrapujemy.pl/sitemap.xml |