przepisy.pl
robots.txt
Robots Exclusion Standard data for przepisy.pl
Resource Scan
Scan Details
| Site Domain | przepisy.pl |
| Base Domain | przepisy.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-17T15:11:20+00:00 |
| Next Scan | 2024-10-15T15:11:20+00:00 |
Last Successful Scan
| Scanned | 2023-08-29T10:53:34+00:00 |
| URL | https://przepisy.pl/robots.txt |
| Redirect | https://www.przepisy.pl/robots.txt |
| Redirect Domain | www.przepisy.pl |
| Redirect Base | przepisy.pl |
| Domain IPs | 54.171.166.213 |
| Redirect IPs | 125.56.219.18, 23.32.29.96 |
| Response IP | 125.56.219.18 |
| Found | Yes |
| Hash | 9203f404a3f75ced8f66d7a362714fc0e59c72e816e5d04e8ce1114a9591bc86 |
| SimHash | e89510742679 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */sort%3D |
| Disallow | *?sort= |
| Disallow | *%26sort%3D |
| Disallow | /blog/szukaj |
| Disallow | /profil |
| Disallow | /preprodapp |
| Disallow | *przepis-pdf* |
| Disallow | *drukuj-przepis* |
| Disallow | *d16534a0800da3478f5d4978199aafe46aa4493872a3257981efc7ed97ccce7c99e3120e63377549bd46ea7c328fdf9235f95aa22fd603a35e99df7185396094* |
| Disallow | /amp/bundles/app/images/ |
| Disallow | /skladniki/*%3Bcategory |
| Disallow | /przepisy/szukaj/*/* |
| Allow | /przepisy/szukaj/*/?page= |
| Allow | /przepisy/szukaj/*/$ |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */sort%3D |
| Disallow | *?sort= |
| Disallow | *%26sort%3D |
| Disallow | /blog/szukaj |
| Disallow | /profil |
| Disallow | /preprodapp |
| Disallow | *przepis-pdf* |
| Disallow | *drukuj-przepis* |
| Disallow | *d16534a0800da3478f5d4978199aafe46aa4493872a3257981efc7ed97ccce7c99e3120e63377549bd46ea7c328fdf9235f95aa22fd603a35e99df7185396094* |
| Disallow | /amp/bundles/app/images/ |
| Disallow | /skladniki/*%3Bcategory |
| Disallow | /przepisy/szukaj/*/* |
| Allow | /przepisy/szukaj/*/?page= |
| Allow | /przepisy/szukaj/*/$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.przepisy.pl/sitemaps/sitemap.xml |
| sitemap | https://www.przepisy.pl/sitemaps/sitemap.xml |
Comments