dstreet.pl
robots.txt
Robots Exclusion Standard data for dstreet.pl
Resource Scan
Scan Details
| Site Domain | dstreet.pl |
| Base Domain | dstreet.pl |
| Scan Status | Ok |
| Last Scan | 2024-09-19T08:54:30+00:00 |
| Next Scan | 2024-10-19T08:54:30+00:00 |
Last Scan
| Scanned | 2024-09-19T08:54:30+00:00 |
| URL | https://dstreet.pl/robots.txt |
| Domain IPs | 5.149.162.234 |
| Response IP | 5.149.162.234 |
| Found | Yes |
| Hash | aad85fd12351439fa1669457fdc5b5d01d24b48f538fd9e05c00743f3eab0649 |
| SimHash | 421cd44103bf |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?rec=* |
| Disallow | /*%26rec%3D* |
*
| Rule | Path |
|---|---|
| Disallow | /basketchange.php |
| Disallow | /basketedit.php |
| Disallow | /basket-onchange.php |
| Disallow | /client-address.php |
| Disallow | /client-addresses.php |
| Disallow | /client-new.php |
| Disallow | /client-orders.php |
| Disallow | /client-save.php |
| Disallow | /client-files.php |
| Disallow | /download-attachment.php |
| Disallow | /login.php |
| Disallow | /loginedit.php |
| Disallow | /loginonce.php |
| Disallow | /membership-card.php |
| Disallow | /order1.php |
| Disallow | /order2.php |
| Disallow | /order3.php |
| Disallow | /ordercancel.php |
| Disallow | /orderconfirm.php |
| Disallow | /orderdetails.php |
| Disallow | /order-document.php |
| Disallow | /order-newpayment.php |
| Disallow | /order-payment.php |
| Disallow | /order-postauction.php |
| Disallow | /order-wrappers.php |
| Disallow | /payments-confirm.php |
| Disallow | /products-bought.php |
| Disallow | /products-requests.php |
| Disallow | /przelew.php |
| Disallow | /rebate-code.php |
| Disallow | /rma-add.php |
| Disallow | /rma-list.php |
| Disallow | /settings.php |
| Disallow | /checkup.php |
| Disallow | /edi/ |
| Disallow | /cat-pol-* |
| Disallow | *?selected_size |
| Disallow | *?filter_traits |
| Disallow | *?filter_sizes |
| Disallow | *?filter_price |
| Disallow | *?filter_node |
| Disallow | /Bestseller-sbestseller-pol.html |
| Disallow | /Nowosci-snewproducts-pol.html |
| Disallow | /ON-bloglist-pol-3.html |
| Disallow | /INSPIRACJE-bloglist-pol-5.html |
| Disallow | /ONA-bloglist-pol-4.html |
| Disallow | /*blogbydate-pol* |
| Disallow | /firm-pol-* |
| Disallow | /pol_m_Promocje_Pomysl-na-Prezent* |
| Disallow | /return.php* |
| Disallow | *?scpush* |
| Disallow | *html?query_id=* |
| Disallow | /tra-pol* |
| Disallow | *lam_trk_start* |
| Disallow | /projector.php |
| Disallow | *lang%3Dpol* |
| Disallow | /search.php |
| Disallow | /signin.php |
| Disallow | /searching.php |
| Disallow | *?amp= |
| Disallow | *?lam_trk_start= |
| Disallow | *?campaign=moday.pl |
| Disallow | *?source=fm |
| Disallow | *?discount=y |
| Disallow | /pol-privacy-and-cookie-notice.html |
| Disallow | /order-open.php |
| Disallow | /lap-okazje-ostatnie-sztuki |
| Disallow | /summer-final-sale-80 |
| Disallow | /Moje-ulubione-produkty-ccms-pol-96.html |
| Disallow | /password-recover.php |
| Disallow | /categories.php |
| Disallow | /product-compare.php |
| Disallow | /pol-terms.html |
| Disallow | *.feed*.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dstreet.pl/sitemap.xml.gz |
| sitemap | https://dstreet.pl/sitemap.xml.gz |
Warnings
- 2 invalid lines.
Comments