hurtel.com
robots.txt
Robots Exclusion Standard data for hurtel.com
Resource Scan
Scan Details
| Site Domain | hurtel.com |
| Base Domain | hurtel.com |
| Scan Status | Ok |
| Last Scan | 2024-09-28T08:38:19+00:00 |
| Next Scan | 2024-10-28T08:38:19+00:00 |
Last Scan
| Scanned | 2024-09-28T08:38:19+00:00 |
| URL | https://hurtel.com/robots.txt |
| Domain IPs | 5.149.163.35 |
| Response IP | 5.149.163.35 |
| Found | Yes |
| Hash | 611d025f46ced6c7ed49da96d35a7dec546b348884bee5e90723ee15b59d7384 |
| SimHash | 1e84d211a49f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?rec=* |
| Disallow | /*%26rec%3D* |
*
| Rule | Path |
|---|---|
| Disallow | /*/basketchange.html |
| Disallow | /*/basketedit.html |
| Disallow | /*/basket-onchange.html |
| Disallow | /*/client-address.html |
| Disallow | /*/client-addresses.html |
| Disallow | /*/client-new.html |
| Disallow | /*/client-orders.html |
| Disallow | /*/client-save.html |
| Disallow | /*/client-files.html |
| Disallow | /*/download-attachment.html |
| Disallow | /*/login.html |
| Disallow | /*/loginedit.html |
| Disallow | /*/loginonce.html |
| Disallow | /*/membership-card.html |
| Disallow | /*/order1.html |
| Disallow | /*/order2.html |
| Disallow | /*/order3.html |
| Disallow | /*/ordercancel.html |
| Disallow | /*/orderconfirm.html |
| Disallow | /*/orderdetails.html |
| Disallow | /*/order-document.html |
| Disallow | /*/order-newpayment.html |
| Disallow | /*/order-payment.html |
| Disallow | /*/order-postauction.html |
| Disallow | /*/order-wrappers.html |
| Disallow | /*/payments-confirm.html |
| Disallow | /*/products-bought.html |
| Disallow | /*/products-requests.html |
| Disallow | /*/przelew.html |
| Disallow | /*/rebate-code.html |
| Disallow | /*/rma-add.html |
| Disallow | /*/rma-list.html |
| Disallow | /*/settings.html |
| Disallow | /*/checkup.html |
| Disallow | /*/rma-open.html |
| Disallow | /*/returns-open.html |
| Disallow | /*/return.html |
| Disallow | /cs/* |
| Disallow | /uk/* |
| Disallow | /edi/* |
| Disallow | /stocks |
| Disallow | /*/stocks/hurtel-magazyn-glowny-1.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hurtel.com/sitemap.xml.gz |
Warnings
- 2 invalid lines.
Comments