Log In Sign Up

cartersoshkosh.ca
robots.txt

Robots Exclusion Standard data for cartersoshkosh.ca

Resource Scan

Scan Details

Site Domain cartersoshkosh.ca
Base Domain cartersoshkosh.ca
Scan Status Ok
Last Scan2026-02-15T02:03:40+00:00
Next Scan 2026-03-17T02:03:40+00:00

Last Scan

Scanned2026-02-15T02:03:40+00:00
URL https://cartersoshkosh.ca/robots.txt
Redirect https://www.cartersoshkosh.ca/robots.txt
Redirect Domain www.cartersoshkosh.ca
Redirect Base cartersoshkosh.ca
Domain IPs 104.18.30.58, 104.18.31.58, 2606:4700::6812:1e3a, 2606:4700::6812:1f3a
Redirect IPs 104.18.30.58, 104.18.31.58, 2606:4700::6812:1e3a, 2606:4700::6812:1f3a
Response IP 104.18.30.58
Found Yes
Hash 308445680d8909956a4f50d05010eebe6d87620b4623cfeb7e4dd5a273631968
SimHash 3f5c7c14676e

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /*/Wishlist-Show
Disallow /*/Account-Show?id=carters
Disallow /*/Cart-Show
Disallow /*pmin*
Disallow /*pmax*
Disallow /*prefn1*
Disallow /*prefn2*
Disallow /*prefn3*
Disallow /*prefn4*
Disallow /*prefv1*
Disallow /*prefv2*
Disallow /*prefv3*
Disallow /*prefv4*
Disallow /*/search*
Disallow /on/demandware.store/Sites-CartersCA-Site/en_CA/Search-Show
Disallow /on/demandware.store/Sites-CartersCA-SFRA-Site/en_CA/PLCC-GetIntercept
Disallow /sitemap1_default.xml
Disallow /sitemap2_default.xml
Disallow /sitemap_1.xml
Disallow /sitemap-carters-default-categories-sitemap.xml
Disallow /sitemap-carters-default-products-sitemap.xml
Disallow /sitemap-carters-default-products_2-sitemap.xml
Disallow /sitemap-carters-default-visual-filters-sitemap.xml
Disallow /sitemap-carters-default_aem-sitemap.xml
Back to top

Other Records

Field Value
sitemap https://www.cartersoshkosh.ca/sitemap_index.xml
Back to top

Comments

  • Uncomment googlebot delay if restricting parameters below doesn't ease bot traffic
  • User-agent: googlebot
  • Crawl-delay: 3
Back to top