butymila.pl
robots.txt
Robots Exclusion Standard data for butymila.pl
Resource Scan
Scan Details
Site Domain | butymila.pl |
Base Domain | butymila.pl |
Scan Status | Ok |
Last Scan | 2024-10-01T03:32:01+00:00 |
Next Scan | 2024-10-31T03:32:01+00:00 |
Last Scan
Scanned | 2024-10-01T03:32:01+00:00 |
URL | https://butymila.pl/robots.txt |
Domain IPs | 5.149.167.249 |
Response IP | 5.149.167.249 |
Found | Yes |
Hash | 51f8a4c905a4917a7bbf4700eb5fcf720248510c3ab1a0a1a1d8ee5fe07645c1 |
SimHash | 1a84d011ae9f |
Groups
*
Rule | Path |
---|---|
Disallow | /*?rec=* |
Disallow | /*%26rec%3D* |
*
Rule | Path |
---|---|
Disallow | /*/basketchange.html |
Disallow | /*/basketedit.html |
Disallow | /*/basket-onchange.html |
Disallow | /*/client-address.html |
Disallow | /*/client-addresses.html |
Disallow | /*/client-new.html |
Disallow | /*/client-orders.html |
Disallow | /*/client-save.html |
Disallow | /*/client-files.html |
Disallow | /*/download-attachment.html |
Disallow | /*/login.html |
Disallow | /*/loginedit.html |
Disallow | /*/loginonce.html |
Disallow | /*/membership-card.html |
Disallow | /*/order1.html |
Disallow | /*/order2.html |
Disallow | /*/order3.html |
Disallow | /*/ordercancel.html |
Disallow | /*/orderconfirm.html |
Disallow | /*/orderdetails.html |
Disallow | /*/order-document.html |
Disallow | /*/order-newpayment.html |
Disallow | /*/order-payment.html |
Disallow | /*/order-postauction.html |
Disallow | /*/order-wrappers.html |
Disallow | /*/payments-confirm.html |
Disallow | /*/products-bought.html |
Disallow | /*/products-requests.html |
Disallow | /*/przelew.html |
Disallow | /*/rebate-code.html |
Disallow | /*/rma-add.html |
Disallow | /*/rma-list.html |
Disallow | /*/settings.html |
Disallow | /*/checkup.html |
Disallow | /*/rma-open.html |
Disallow | /*/returns-open.html |
Disallow | /*/return.html |
Disallow | edi/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://butymila.pl/sitemap.xml.gz |
Warnings
- 2 invalid lines.
Comments