cb2.com
robots.txt
Robots Exclusion Standard data for cb2.com
Resource Scan
Scan Details
| Site Domain | cb2.com |
| Base Domain | cb2.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-04T06:38:46+00:00 |
| Next Scan | 2024-12-03T06:38:46+00:00 |
Last Successful Scan
| Scanned | 2023-07-20T06:27:20+00:00 |
| URL | https://cb2.com/robots.txt |
| Redirect | https://www.cb2.com/robots.txt |
| Redirect Domain | www.cb2.com |
| Redirect Base | cb2.com |
| Domain IPs | 23.203.79.131 |
| Redirect IPs | 23.203.79.131 |
| Response IP | 184.30.9.212 |
| Found | Yes |
| Hash | fdfd3c187788e1b74330484ab5aa6e8ce2e63c8379d038ca2d503e1164876c64 |
| SimHash | 4925117d5b03 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /Account/ |
| Allow | /account/order-tracking |
| Disallow | /bin/ |
| Disallow | /checkout/ |
| Disallow | /Checkout/ |
| Disallow | /manager/ |
| Disallow | /Manager/ |
| Disallow | /Reviews/SubmitReview |
| Disallow | /Assembly-Instructions/ |
| Disallow | /stores/availability/ |
| Disallow | /Reviews/ReviewAuthenticity |
| Disallow | /favorites/ |
| Disallow | /CartNavigation/ |
| Allow | /search |
| Disallow | /search?* |
| Disallow | /Popup/ |
| Disallow | /Popup? |
| Disallow | /popup/ |
| Disallow | /gift-registry/store-pickup-options-availability |
| Disallow | /SharedLayer/ |
| Disallow | /filters/ |
| Disallow | /*.aspx$ |
| Disallow | /Browse/* |
| Disallow | /browse/* |
| Disallow | /CartNavigation/GetCartNavigation |
| Disallow | /dynamic-digital-data/init |
| Disallow | /header/get-account-navigation |
| Disallow | /favorites/HasFavorites |
| Disallow | /*?subject |
| Disallow | /*%2B1-800.606.6252 |
| Disallow | /Browse/UserData/* |
| Disallow | /search_noresults? |
pinterestbot
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /Account/ |
| Allow | /account/order-tracking |
| Disallow | /bin/ |
| Disallow | /checkout/ |
| Disallow | /Checkout/ |
| Disallow | /manager/ |
| Disallow | /Manager/ |
| Disallow | /Reviews/SubmitReview |
| Disallow | /Assembly-Instructions/ |
| Disallow | /stores/availability/ |
| Disallow | /Reviews/ReviewAuthenticity |
| Disallow | /favorites/ |
| Disallow | /CartNavigation/ |
| Allow | /search |
| Disallow | /search?* |
| Disallow | /Popup/ |
| Disallow | /Popup? |
| Disallow | /popup/ |
| Disallow | /gift-registry/store-pickup-options-availability |
| Disallow | /SharedLayer/ |
| Disallow | /filters/ |
| Disallow | /*.aspx$ |
| Disallow | /Browse/* |
| Disallow | /browse/* |
| Disallow | /CartNavigation/GetCartNavigation |
| Disallow | /dynamic-digital-data/init |
| Disallow | /header/get-account-navigation |
| Disallow | /favorites/HasFavorites |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /Account/ |
| Allow | /account/order-tracking |
| Disallow | /bin/ |
| Disallow | /checkout/ |
| Disallow | /Checkout/ |
| Disallow | /manager/ |
| Disallow | /Manager/ |
| Disallow | /Reviews/SubmitReview |
| Disallow | /Assembly-Instructions/ |
| Disallow | /stores/availability/ |
| Disallow | /Reviews/ReviewAuthenticity |
| Disallow | /favorites/ |
| Disallow | /CartNavigation/ |
| Allow | /search |
| Disallow | /search?* |
| Disallow | /Popup/ |
| Disallow | /Popup? |
| Disallow | /popup/ |
| Disallow | /gift-registry/store-pickup-options-availability |
| Disallow | /SharedLayer/ |
| Disallow | /filters/ |
| Disallow | /*.aspx$ |
| Disallow | /Browse/* |
| Disallow | /browse/* |
| Disallow | /CartNavigation/GetCartNavigation |
| Disallow | /dynamic-digital-data/init |
| Disallow | /header/get-account-navigation |
| Disallow | /favorites/HasFavorites |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cb2.com/assets/sitemap-index.xml |
Comments