b2b.specialized.com
robots.txt
Robots Exclusion Standard data for b2b.specialized.com
Resource Scan
Scan Details
| Site Domain | b2b.specialized.com |
| Base Domain | specialized.com |
| Scan Status | Ok |
| Last Scan | 2025-05-24T09:02:59+00:00 |
| Next Scan | 2025-06-23T09:02:59+00:00 |
Last Scan
| Scanned | 2025-05-24T09:02:59+00:00 |
| URL | https://b2b.specialized.com/robots.txt |
| Domain IPs | 104.18.41.22, 172.64.146.234, 2606:4700:4400::6812:2916, 2606:4700:4400::ac40:92ea |
| Response IP | 172.64.146.234 |
| Found | Yes |
| Hash | d4855d0961620a883cd11bbf437ba81f2742073dd72a807f13b2e0782088ade1 |
| SimHash | cb524c94e3f4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ccstore |
| Disallow | /ccstoreui |
| Disallow | /cart |
| Disallow | /en/cart |
| Disallow | /pl/cart |
| Disallow | /zh_CN/cart |
| Disallow | /zh_TW/cart |
| Disallow | /en_AU/cart |
| Disallow | /cs/cart |
| Disallow | /da/cart |
| Disallow | /de/cart |
| Disallow | /es/cart |
| Disallow | /fr/cart |
| Disallow | /it/cart |
| Disallow | /en_GB/cart |
| Disallow | /nl/cart |
| Disallow | /sv/cart |
| Disallow | /no/cart |
| Disallow | /pt/cart |
| Disallow | /fr_CA/cart |
| Disallow | /fi/cart |
| Disallow | /checkout |
| Disallow | /en/checkout |
| Disallow | /pl/checkout |
| Disallow | /zh_CN/checkout |
| Disallow | /zh_TW/checkout |
| Disallow | /en_AU/checkout |
| Disallow | /cs/checkout |
| Disallow | /da/checkout |
| Disallow | /de/checkout |
| Disallow | /es/checkout |
| Disallow | /fr/checkout |
| Disallow | /it/checkout |
| Disallow | /en_GB/checkout |
| Disallow | /nl/checkout |
| Disallow | /sv/checkout |
| Disallow | /no/checkout |
| Disallow | /pt/checkout |
| Disallow | /fr_CA/checkout |
| Disallow | /fi/checkout |
| Disallow | /profile |
| Disallow | /en/profile |
| Disallow | /pl/profile |
| Disallow | /zh_CN/profile |
| Disallow | /zh_TW/profile |
| Disallow | /en_AU/profile |
| Disallow | /cs/profile |
| Disallow | /da/profile |
| Disallow | /de/profile |
| Disallow | /es/profile |
| Disallow | /fr/profile |
| Disallow | /it/profile |
| Disallow | /en_GB/profile |
| Disallow | /nl/profile |
| Disallow | /sv/profile |
| Disallow | /no/profile |
| Disallow | /pt/profile |
| Disallow | /fr_CA/profile |
| Disallow | /fi/profile |
| Disallow | /searchresults |
| Disallow | /en/searchresults |
| Disallow | /pl/searchresults |
| Disallow | /zh_CN/searchresults |
| Disallow | /zh_TW/searchresults |
| Disallow | /en_AU/searchresults |
| Disallow | /cs/searchresults |
| Disallow | /da/searchresults |
| Disallow | /de/searchresults |
| Disallow | /es/searchresults |
| Disallow | /fr/searchresults |
| Disallow | /it/searchresults |
| Disallow | /en_GB/searchresults |
| Disallow | /nl/searchresults |
| Disallow | /sv/searchresults |
| Disallow | /no/searchresults |
| Disallow | /pt/searchresults |
| Disallow | /fr_CA/searchresults |
| Disallow | /fi/searchresults |
| Disallow | /confirmation |
| Disallow | /en/confirmation |
| Disallow | /pl/confirmation |
| Disallow | /zh_CN/confirmation |
| Disallow | /zh_TW/confirmation |
| Disallow | /en_AU/confirmation |
| Disallow | /cs/confirmation |
| Disallow | /da/confirmation |
| Disallow | /de/confirmation |
| Disallow | /es/confirmation |
| Disallow | /fr/confirmation |
| Disallow | /it/confirmation |
| Disallow | /en_GB/confirmation |
| Disallow | /nl/confirmation |
| Disallow | /sv/confirmation |
| Disallow | /no/confirmation |
| Disallow | /pt/confirmation |
| Disallow | /fr_CA/confirmation |
| Disallow | /fi/confirmation |
| Disallow | /wishlist_settings |
| Disallow | /en/wishlist_settings |
| Disallow | /pl/wishlist_settings |
| Disallow | /zh_CN/wishlist_settings |
| Disallow | /zh_TW/wishlist_settings |
| Disallow | /en_AU/wishlist_settings |
| Disallow | /cs/wishlist_settings |
| Disallow | /da/wishlist_settings |
| Disallow | /de/wishlist_settings |
| Disallow | /es/wishlist_settings |
| Disallow | /fr/wishlist_settings |
| Disallow | /it/wishlist_settings |
| Disallow | /en_GB/wishlist_settings |
| Disallow | /nl/wishlist_settings |
| Disallow | /sv/wishlist_settings |
| Disallow | /no/wishlist_settings |
| Disallow | /pt/wishlist_settings |
| Disallow | /fr_CA/wishlist_settings |
| Disallow | /fi/wishlist_settings |
| Disallow | /wishlist |
| Disallow | /en/wishlist |
| Disallow | /pl/wishlist |
| Disallow | /zh_CN/wishlist |
| Disallow | /zh_TW/wishlist |
| Disallow | /en_AU/wishlist |
| Disallow | /cs/wishlist |
| Disallow | /da/wishlist |
| Disallow | /de/wishlist |
| Disallow | /es/wishlist |
| Disallow | /fr/wishlist |
| Disallow | /it/wishlist |
| Disallow | /en_GB/wishlist |
| Disallow | /nl/wishlist |
| Disallow | /sv/wishlist |
| Disallow | /no/wishlist |
| Disallow | /pt/wishlist |
| Disallow | /fr_CA/wishlist |
| Disallow | /fi/wishlist |
Other Records
| Field | Value |
|---|---|
| sitemap | https://b2b.specialized.com/sitemap.xml |