engels.eu
robots.txt
Robots Exclusion Standard data for engels.eu
Resource Scan
Scan Details
| Site Domain | engels.eu |
| Base Domain | engels.eu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-25T05:32:51+00:00 |
| Next Scan | 2026-02-23T05:32:51+00:00 |
Last Successful Scan
| Scanned | 2025-01-06T18:38:47+00:00 |
| URL | https://engels.eu/robots.txt |
| Domain IPs | 104.26.14.67, 104.26.15.67, 172.67.72.96, 2606:4700:20::681a:e43, 2606:4700:20::681a:f43, 2606:4700:20::ac43:4860 |
| Response IP | 104.26.14.67 |
| Found | Yes |
| Hash | 885aab1110e0e65ae31a6745ea135cff17c106904539d47e423a6dacaf8dc5da |
| SimHash | 08b4f046cdc6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /index.php/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /wishlist/ |
| Disallow | /admin/ |
| Disallow | /onestepcheckout/ |
| Disallow | /customer/ |
| Disallow | /review/product/ |
| Disallow | /sendfriend/ |
| Disallow | /enable-cookies/ |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE.html |
| Disallow | /skin/ |
| Disallow | /js/ |
| Disallow | /directory/ |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /catalogsearch/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /*?dir* |
| Disallow | /*?dir=desc |
| Disallow | /*?dir=asc |
| Disallow | /*?limit=all |
| Disallow | /*?mode* |
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
Warnings
- 5 invalid lines.
- `blocking native catalog and search pages` is not a known field.
- `stop crawling user account and checkout pages by search engine robot` is not a known field.