decathlon.es
robots.txt

Robots Exclusion Standard data for decathlon.es

Resource Scan

Scan Details

Site Domain decathlon.es
Base Domain decathlon.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-20T19:01:10+00:00
Next Scan 2024-11-19T19:01:10+00:00

Last Successful Scan

Scanned2024-07-16T15:29:11+00:00
URL https://decathlon.es/robots.txt
Redirect https://www.decathlon.es/robots.txt
Redirect Domain www.decathlon.es
Redirect Base decathlon.es
Domain IPs 104.18.30.161, 104.18.31.161
Redirect IPs 104.18.41.42, 172.64.146.214
Response IP 172.64.146.214
Found Yes
Hash 1cb83f85b065550b002c0ac522f7d457bdfb68dd40be4fc207a57a0617438798
SimHash 5573124f27fc

Groups

*

Rule Path
Disallow /*product-review-post*
Disallow /*utility/vote/
Disallow /*notes%3D*
Disallow /*?offer=*
Disallow /*direction%3D*
Disallow /*/p-r/*
Disallow /*sort%3D*
Disallow /r/*page%3D*
Disallow /*reviewsNext
Disallow /*pageReviews
Disallow /*reviewsProductPage
Disallow *?id_category
Disallow *?p=
Disallow *?reviews
Disallow /*/2-root-category
Disallow /*?offer=*
Disallow /*~*/*~*/
Disallow */lib/
Disallow */stringify-jsurl
Disallow /*redirectUrl%3D*
Disallow /*/_/0$
Disallow /*CustomProductCatalog*
Disallow /es/ajax/
Allow /es/ajax/nfs/translations
Allow /es/ajax/nfs/brands
Allow /es/ajax/nfs/menu
Disallow /_Incapsula_Resource*
Disallow /*CartLink_updateCartSize
Disallow /p//
Disallow /*dynaTraceMonitor*
Disallow *adin%3D
Disallow /*mc%3D*
Disallow *?s=
Disallow *?showMoreIds=
Allow /*LGWCODE%3D*
Disallow /search?Ntt=*
Disallow /*/search
Disallow /*/search?*
Disallow */store-reviews*
Disallow */store-review-post
Disallow */workshop-reviews*
Disallow */workshop-review-post*
Disallow /ca/
Disallow */ca/
Disallow */in/
Disallow */en/
Disallow /*?_requestid=*
Disallow */help/app/home/
Disallow */help/app/ask/*
Disallow /p-a/*
Disallow /*/help/app/ask_store/store_code/*
Disallow /*?Ns=*
Disallow /*%26Ns%3D*
Disallow /sitemap-index.xml

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.decathlon.es/sitemap/mp-product-0.xml
sitemap https://www.decathlon.es/sitemap/mp-product-1.xml
sitemap https://www.decathlon.es/sitemap/product-0.xml
sitemap https://www.decathlon.es/sitemap/sport-0.xml
sitemap https://www.decathlon.es/sitemap/brand-0.xml
sitemap https://www.decathlon.es/sitemap/landing-0.xml
sitemap https://www.decathlon.es/sitemap/product-review-0.xml
sitemap https://www.decathlon.es/sitemap/category-product-listing-0.xml
sitemap https://www.decathlon.es/sitemap/filtered-pages-0.xml

Comments

  • ROBOTS.TXT CONFIG
  • 20240711
  • SITEMAPS
  • 15/07/2021
  • REVIEWS
  • 09/07/2019
  • 27/02/2019
  • UPDATE 17/01/2019
  • UPDATE 22/07/2019
  • REVIEWS PAGINATION
  • 08/04/2019
  • 27/06/2019
  • 09/03/2020
  • FITERED PAGES or PAGINATE
  • 25/03/2019
  • DUST
  • 24/07/2023
  • 29/10/2022
  • UPDATE OCTOBER 2018
  • PERF MONITORING TOOL
  • 14/03/2019
  • ANALYTICS TOOL
  • 05/08/2021
  • PRODUCT URLS
  • UPDATE 29/04/2019
  • UPDATE 08/04/2019
  • UPDATE 31/01/2019
  • INTERNAL SEARCH
  • UPDATE 20/03/2019
  • STOREPAGE
  • UPDATE 08/04/2019
  • UPDATE 31/01/2019
  • UPDATE 20/03/2019
  • CATALAN
  • UPDATE 06/07/2021
  • COUNTRIES
  • HELP
  • UPDATE 17/01/2019
  • UPDATE 31/01/2019
  • Assistance pages
  • UPDATE 25/03/2019
  • Sorting - dec. 23
  • Block smp until fix on /ca/
  • 2023-10-17 Majestic limit
  • 2024-03-29 FacebookBot limit