muziker.com
robots.txt
Robots Exclusion Standard data for muziker.com
Resource Scan
Scan Details
| Site Domain | muziker.com |
| Base Domain | muziker.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-27T02:53:53+00:00 |
| Next Scan | 2025-01-25T02:53:53+00:00 |
Last Successful Scan
| Scanned | 2024-06-07T01:51:53+00:00 |
| URL | https://muziker.com/robots.txt |
| Redirect | https://www.muziker.com/robots.txt |
| Redirect Domain | www.muziker.com |
| Redirect Base | muziker.com |
| Domain IPs | 104.26.14.74, 104.26.15.74, 172.67.74.54, 2606:4700:20::681a:e4a, 2606:4700:20::681a:f4a, 2606:4700:20::ac43:4a36 |
| Redirect IPs | 104.26.14.74, 104.26.15.74, 172.67.74.54, 2606:4700:20::681a:e4a, 2606:4700:20::681a:f4a, 2606:4700:20::ac43:4a36 |
| Response IP | 172.67.74.54 |
| Found | Yes |
| Hash | f335435c82f357442f73bcbbc781e8352ec0cb65e85928d2f021af4e9abafacf |
| SimHash | 68360c9e6c5e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.muziker.com/sitemap.xml |