muziker.it
robots.txt
Robots Exclusion Standard data for muziker.it
Resource Scan
Scan Details
| Site Domain | muziker.it |
| Base Domain | muziker.it |
| Scan Status | Ok |
| Last Scan | 2024-05-23T16:51:02+00:00 |
| Next Scan | 2024-06-22T16:51:02+00:00 |
Last Scan
| Scanned | 2024-05-23T16:51:02+00:00 |
| URL | https://muziker.it/robots.txt |
| Redirect | https://www.muziker.it/robots.txt |
| Redirect Domain | www.muziker.it |
| Redirect Base | muziker.it |
| Domain IPs | 104.26.6.88, 104.26.7.88, 172.67.74.147, 2606:4700:20::681a:658, 2606:4700:20::681a:758, 2606:4700:20::ac43:4a93 |
| Redirect IPs | 104.26.6.88, 104.26.7.88, 172.67.74.147, 2606:4700:20::681a:658, 2606:4700:20::681a:758, 2606:4700:20::ac43:4a93 |
| Response IP | 104.26.7.88 |
| Found | Yes |
| Hash | 2c357d539e090f946d46a28478a0ee2ff8cf22b570b6239acd5f6335365f8fdb |
| SimHash | 28360c9e7c5a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /lt/ |
| Disallow | /uk/ |
| Disallow | /lv/ |
| Disallow | /es/ |
| Disallow | /et/ |
| Disallow | /nl/ |
| Disallow | /da/ |
| Disallow | /pt/ |
| Disallow | /sv/ |
| Disallow | /el/ |
| Disallow | /fi/ |
| Disallow | /sr/ |
| Disallow | /en/ |
| Disallow | /cs/ |
| Disallow | /sk/ |
| Disallow | /de/ |
| Disallow | /hu/ |
| Disallow | /pl/ |
| Disallow | /sl/ |
| Disallow | /ro/ |
| Disallow | /bg/ |
| Disallow | /hr/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /login |
| Disallow | /register |
| Disallow | /search |
| Disallow | /shop/basket |
| Disallow | /products/*/ask_price_requests/new |
| Disallow | /products/*/unsaleable_requests/new |
| Disallow | /products/*/query_requests/new |
| Disallow | /products/*/report_mistake_requests/new |
| Disallow | /products/*/warehouse_availability_requests/new |
| Disallow | /products/*/negotiate_price_requests/new |
| Disallow | /products/*/watch_dogs/new |
| Disallow | /products/*/reservations/new |
| Disallow | /products/* |
| Disallow | /shop/wish_list_items |
| Disallow | /product_comparison_items |
| Disallow | /countries_selectors |
| Disallow | /userset/*/product_detail |
| Disallow | /shop/actions/* |
| Disallow | /client/ |
| Disallow | /store/ |
| Disallow | /orders/* |
| Disallow | /payments/paypal/ |
| Disallow | /payments/adyen-express-checkout/ |
| Disallow | /auth/ |
| Disallow | /cookies/ |
| Disallow | /p/ |
| Disallow | /pages/ |
| Disallow | /*s%3D* |
| Disallow | /*cart_sum%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*wl_add%3D* |
| Disallow | /*sort_by* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.muziker.it/sitemap.xml |