walmartfinancial.ca
robots.txt

Robots Exclusion Standard data for walmartfinancial.ca

Resource Scan

Scan Details

Site Domain walmartfinancial.ca
Base Domain walmartfinancial.ca
Scan Status Ok
Last Scan2025-10-03T18:25:37+00:00
Next Scan 2025-10-10T18:25:37+00:00

Last Scan

Scanned2025-10-03T18:25:37+00:00
URL http://walmartfinancial.ca/robots.txt
Redirect https://www.walmart.ca/robots.txt
Redirect Domain www.walmart.ca
Redirect Base walmart.ca
Domain IPs 161.170.230.53, 161.170.239.53
Redirect IPs 23.207.193.24
Response IP 23.53.217.39
Found Yes
Hash e00d6d9d2d95da92abadece9afba468bcf8b9e9b8dbf0eb069e9f96b832858ea
SimHash 26935d0a4725

Groups

*

Rule Path
Disallow /en/*%2B*
Disallow /fr/*%2B*
Disallow /ws/*
Disallow /webjars/*
Disallow /css-pattern-library
Disallow /*/app$
Disallow /*/global$
Disallow /cart
Disallow /panier
Disallow /search/*
Disallow /cherche/*
Disallow /search?*
Disallow /recherche?*
Disallow /en/search
Disallow /search?*z=1
Disallow /en/search?*z=1
Disallow /en/kiosk/*
Disallow /fr/kiosk/*
Disallow /*/associates
Disallow /*?f=*
Disallow /ce/*?c=*
Disallow /cf/*?c=*
Disallow /ouvrir-une-session*
Disallow /sign-in*
Disallow /en/ip/*/*null$
Disallow /fr/ip/*/*null$
Disallow /en/ip/*
Allow /en/ip/*/*
Disallow /fr/ip/*
Allow /fr/ip/*/*
Disallow /fr/en/ip/*
Disallow /en/*%26b%3D1*
Disallow /en/*?facet=*&b=1*
Disallow /fr/*%26b%3D1*
Disallow /fr/*?facet=*&b=1*
Disallow /en/search?*x=1
Disallow /fr/search?*x=1
Disallow /en/email/gifts-voucher
Disallow /en/financial-services/walmart-rewards-mastercard-apply-now
Disallow /fr/services-financiers/recompenses-walmart-mastercard-faire-une-demande
Disallow /*YnJhbmQ6
Disallow /account/login/*
Disallow /account/logout/*
Disallow /en/reviews/write-review
Disallow /fr/reviews/write-review
Disallow /redirect/identity

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.walmart.ca/sitemap-categories.xml
sitemap https://www.walmart.ca/sitemap-brand-1p-en.xml
sitemap https://www.walmart.ca/sitemap-brand-3p-en.xml
sitemap https://www.walmart.ca/sitemap-brand-1p-fr.xml
sitemap https://www.walmart.ca/sitemap-brand-3p-fr.xml
sitemap https://www.walmart.ca/sitemap-collections.xml
sitemap https://www.walmart.ca/sitemap-collections-ca.xml
sitemap https://www.walmart.ca/sitemap-product-1p-en.xml
sitemap https://www.walmart.ca/sitemap-product-3p-head-en.xml
sitemap https://www.walmart.ca/sitemap-product-3p-en.xml
sitemap https://www.walmart.ca/sitemap-product-1p-fr.xml
sitemap https://www.walmart.ca/sitemap-product-3p-head-fr.xml
sitemap https://www.walmart.ca/sitemap-product-3p-fr.xml
sitemap https://www.walmart.ca/sitemap-topic.xml
sitemap https://www.walmart.ca/sitemap-cp.xml

Comments

  • Prevent refined browse pages from being crawled, avoiding millions of near-duplicate entries. MG IG
  • Now allowing assets to be crawled. MG
  • Disallow: /assets/*
  • Prevents Financial Services One and Done page from being hit. 11-16-2016 NV
  • Prevents Financial WM MC page from being hit, contains promocodes. 11-16-2016 NV
  • Rate limiting for Bingbots
  • Adding new rules
  • Ending of robots.txt