sportler.com
robots.txt
Robots Exclusion Standard data for sportler.com
Resource Scan
Scan Details
| Site Domain | sportler.com |
| Base Domain | sportler.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T17:55:02+00:00 |
| Next Scan | 2024-10-23T17:55:02+00:00 |
Last Scan
| Scanned | 2024-09-23T17:55:02+00:00 |
| URL | https://sportler.com/robots.txt |
| Redirect | https://www.sportler.com/robots.txt |
| Redirect Domain | www.sportler.com |
| Redirect Base | sportler.com |
| Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Response IP | 199.232.46.133 |
| Found | Yes |
| Hash | 41fa65399b51acfc436c9095018a64408e65984c5a0cbf63d6f8b13ec08ec6de |
| SimHash | cc7e9179d3fd |
Groups
adsbot-google-mobile
adsbot-google
mediapartners-google
googlebot-image
googlebot-news
googlebot-video
adsbot-google-mobile-apps
feedfetcher-google
google-read-aloud
duplexweb-google
googleweblight
storebot-google
| Rule | Path |
|---|---|
| Disallow | /en |
| Disallow | /en/* |
| Disallow | /Portal.po |
| Disallow | /Upload.po |
| Disallow | /warenkorb |
| Disallow | /carrello |
| Disallow | /suche |
| Disallow | /ricerca |
| Disallow | /it/UpdateShortBasket-Process |
| Disallow | /de/UpdateShortBasket-Process |
| Disallow | /it/FactFinderSuggestRequestProxy |
| Disallow | /de/FactFinderSuggestRequestProxy |
| Disallow | /de/ProcessAddProductsToShortBasket |
| Disallow | /it/ProcessAddProductsToShortBasket |
| Disallow | /de/ProcessAddBundleToShortBasket |
| Disallow | /it/ProcessAddBundleToShortBasket |
| Disallow | /de/ViewRequestBundleForm |
| Disallow | /it/ViewRequestBundleForm |
| Disallow | /de/ViewBasketShort |
| Disallow | /it/ViewBasketShort |
| Disallow | /de/WriteAllowCookie |
| Disallow | /it/WriteAllowCookie |
| Disallow | /de/AjaxViewSetBuilder |
| Disallow | /it/AjaxViewSetBuilder |
| Disallow | /de/AjaxViewToursSetBuilder |
| Disallow | /it/AjaxViewToursSetBuilder |
| Disallow | /de/AjaxProcessSelectMultisetProduct |
| Disallow | /it/AjaxProcessSelectMultisetProduct |
| Disallow | /de/AjaxProcessSelectToursMultisetProduct |
| Disallow | /it/AjaxProcessSelectToursMultisetProduct |
| Disallow | /de/AjaxMultiSetVariationChange |
| Disallow | /it/AjaxMultiSetVariationChange |
| Disallow | /de/AjaxProductDetailAddToBasketForm |
| Disallow | /it/AjaxProductDetailAddToBasketForm |
| Disallow | /de/AjaxBestMatchAdditionalProductImages |
| Disallow | /it/AjaxBestMatchAdditionalProductImages |
| Disallow | /it/AjaxInvoiceAddressForm |
| Disallow | /de/AjaxInvoiceAddressForm |
| Disallow | /it/AjaxAddressForm |
| Disallow | /de/AjaxAddressForm |
| Disallow | /it/AjaxInvoiceAddressFormAutoComplete |
| Disallow | /de/AjaxInvoiceAddressFormAutoComplete |
| Disallow | /it/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxAddressFormAutoComplete |
| Disallow | /it/AjaxShippingAddressForm |
| Disallow | /de/AjaxShippingAddressForm |
| Disallow | /it/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxGetManufacturersSubMenu |
| Disallow | /it/AjaxGetManufacturersSubMenu |
| Disallow | /de/AjaxGetCatalogSubMenu |
| Disallow | /it/AjaxGetCatalogSubMenu |
| Disallow | /de/WriteAllowCookie |
| Disallow | /it/WriteAllowCookie |
| Disallow | /it/ProductStockhouseInformation |
| Disallow | /de/ProductStockhouseInformation |
| Disallow | /de/AjaxPersonalizedContentLandingPage |
| Disallow | /de/AjaxPersonalizedContentProductDetail |
| Disallow | /de/AjaxPersonalizedContentProductList |
| Disallow | /de/AjaxViewBundleBuilder |
| Disallow | /de/AjaxViewSetBuilder |
| Disallow | /it/AjaxPersonalizedContentLandingPage |
| Disallow | /it/AjaxPersonalizedContentProductDetail |
| Disallow | /it/AjaxPersonalizedContentProductList |
| Disallow | /it/AjaxViewBundleBuilder |
| Disallow | /it/AjaxViewSetBuilder |
| Disallow | */l/it/* |
| Disallow | */l/en/* |
| Disallow | */l/de/* |
| Disallow | */vai/* |
| Disallow | */go/* |
| Disallow | */go-to/* |
| Disallow | */de/i/* |
| Disallow | */it/i/* |
| Disallow | */en/i/* |
| Disallow | *pageResults%3D* |
| Disallow | *open%3D* |
| Disallow | /*.pdf$ |
| Disallow | /*productSort |
| Disallow | /Upload.po |
| Disallow | /jsp/TradeDoublerRedirect.jsp |
| Disallow | /zoom |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /en |
| Disallow | /en/* |
| Disallow | /Portal.po |
| Disallow | /Upload.po |
| Disallow | /warenkorb |
| Disallow | /carrello |
| Disallow | /suche |
| Disallow | /ricerca |
| Disallow | /it/UpdateShortBasket-Process |
| Disallow | /de/UpdateShortBasket-Process |
| Disallow | /it/FactFinderSuggestRequestProxy |
| Disallow | /de/FactFinderSuggestRequestProxy |
| Disallow | /de/ProcessAddProductsToShortBasket |
| Disallow | /it/ProcessAddProductsToShortBasket |
| Disallow | /de/ProcessAddBundleToShortBasket |
| Disallow | /it/ProcessAddBundleToShortBasket |
| Disallow | /de/ViewRequestBundleForm |
| Disallow | /it/ViewRequestBundleForm |
| Disallow | /de/ViewBasketShort |
| Disallow | /it/ViewBasketShort |
| Disallow | /de/WriteAllowCookie |
| Disallow | /it/WriteAllowCookie |
| Disallow | /de/AjaxViewSetBuilder |
| Disallow | /it/AjaxViewSetBuilder |
| Disallow | /de/AjaxViewToursSetBuilder |
| Disallow | /it/AjaxViewToursSetBuilder |
| Disallow | /de/AjaxProcessSelectMultisetProduct |
| Disallow | /it/AjaxProcessSelectMultisetProduct |
| Disallow | /de/AjaxProcessSelectToursMultisetProduct |
| Disallow | /it/AjaxProcessSelectToursMultisetProduct |
| Disallow | /de/AjaxMultiSetVariationChange |
| Disallow | /it/AjaxMultiSetVariationChange |
| Disallow | /de/AjaxProductDetailAddToBasketForm |
| Disallow | /it/AjaxProductDetailAddToBasketForm |
| Disallow | /de/AjaxBestMatchAdditionalProductImages |
| Disallow | /it/AjaxBestMatchAdditionalProductImages |
| Disallow | /it/AjaxInvoiceAddressForm |
| Disallow | /de/AjaxInvoiceAddressForm |
| Disallow | /it/AjaxAddressForm |
| Disallow | /de/AjaxAddressForm |
| Disallow | /it/AjaxInvoiceAddressFormAutoComplete |
| Disallow | /de/AjaxInvoiceAddressFormAutoComplete |
| Disallow | /it/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxAddressFormAutoComplete |
| Disallow | /it/AjaxShippingAddressForm |
| Disallow | /de/AjaxShippingAddressForm |
| Disallow | /it/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxAddressFormAutoComplete |
| Disallow | /de/AjaxGetManufacturersSubMenu |
| Disallow | /it/AjaxGetManufacturersSubMenu |
| Disallow | /de/AjaxGetCatalogSubMenu |
| Disallow | /it/AjaxGetCatalogSubMenu |
| Disallow | /de/WriteAllowCookie |
| Disallow | /it/WriteAllowCookie |
| Disallow | /it/ProductStockhouseInformation |
| Disallow | /de/ProductStockhouseInformation |
| Disallow | /de/AjaxPersonalizedContentLandingPage |
| Disallow | /de/AjaxPersonalizedContentProductDetail |
| Disallow | /de/AjaxPersonalizedContentProductList |
| Disallow | /de/AjaxViewBundleBuilder |
| Disallow | /de/AjaxViewSetBuilder |
| Disallow | /it/AjaxPersonalizedContentLandingPage |
| Disallow | /it/AjaxPersonalizedContentProductDetail |
| Disallow | /it/AjaxPersonalizedContentProductList |
| Disallow | /it/AjaxViewBundleBuilder |
| Disallow | /it/AjaxViewSetBuilder |
| Disallow | */l/it/* |
| Disallow | */l/en/* |
| Disallow | */l/de/* |
| Disallow | */vai/* |
| Disallow | */go/* |
| Disallow | */go-to/* |
| Disallow | */de/i/* |
| Disallow | */it/i/* |
| Disallow | */en/i/* |
| Disallow | *pageResults%3D* |
| Disallow | *open%3D* |
| Disallow | /*.pdf$ |
| Disallow | /*productSort |
| Disallow | /Upload.po |
| Disallow | /jsp/TradeDoublerRedirect.jsp |
| Disallow | /zoom |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sportler.com/exports/sitemap_index.xml |
| sitemap | https://www.sportler.com/styla-exports/de_sitemap_index.xml |
| sitemap | https://www.sportler.com/styla-exports/it_sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments