decathlon.pl
robots.txt

Robots Exclusion Standard data for decathlon.pl

Resource Scan

Scan Details

Site Domain decathlon.pl
Base Domain decathlon.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T00:18:55+00:00
Next Scan 2024-11-18T00:18:55+00:00

Last Successful Scan

Scanned2024-07-15T00:07:43+00:00
URL https://decathlon.pl/robots.txt
Redirect https://www.decathlon.pl/robots.txt
Redirect Domain www.decathlon.pl
Redirect Base decathlon.pl
Domain IPs 104.18.0.207, 104.18.1.207
Redirect IPs 104.18.37.138, 172.64.150.118
Response IP 104.18.37.138
Found Yes
Hash d1b409d83cfe64ff1cbcc00f2829c31b4f4d6aacc5bf55bb87ee5ac51d1516ce
SimHash 2f15164b678f

Groups

*

Rule Path
Disallow /*product-review-post*
Disallow /p-r/
Disallow /*utility/vote/
Disallow /*notes%3D*
Disallow /*?offer=*
Disallow /*sort%3D*
Disallow /*direction%3D*
Disallow /*?Ndrc=*
Disallow /*?offer=*
Disallow /*~*/*~*/
Disallow /*redirectUrl%3D*
Disallow /*/_/0$
Disallow /*CustomProductCatalog*
Disallow /*reviewsNext
Disallow /*CartLink_updateCartSize
Disallow /*pageReviews
Disallow /*reviewsProductPage
Disallow /p//
Disallow */ajax/
Disallow */lib/hit
Disallow */stringify-jsurl
Disallow /*dynaTraceMonitor
Disallow /search?Ntt=*
Disallow /search?*
Disallow /search
Disallow /?q=*
Disallow /r/*page%3D*
Disallow /search?Ntt=*
Disallow /store-review-post*
Disallow /p-a/*
Disallow *reviews_page%3D*
Disallow *reviews_note%3D*
Disallow /_Incapsula_Resource*
Disallow /*?Ns=*
Disallow /*%26Ns%3D*
Disallow /cdn-cgi/

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

facebookbot

Rule Path
Disallow /*/f-*_*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.decathlon.pl/sitemap/index.xml
sitemap https://www.decathlon.pl/sitemap-index.xml
sitemap https://www.decathlon.pl/sitemap/product-0.xml
sitemap https://www.decathlon.pl/sitemap/category-product-listing-0.xml
sitemap https://www.decathlon.pl/sitemap/sport-0.xml
sitemap https://www.decathlon.pl/sitemap/landing-0.xml
sitemap https://www.decathlon.pl/sitemap/mp-product-0.xml
sitemap https://www.decathlon.pl/sitemap/mp-product-1.xml
sitemap https://www.decathlon.pl/sitemap/mp-product-2.xml
sitemap https://www.decathlon.pl/sitemap/brand-0.xml

Comments

  • ROBOTS.TXT CONFIG
  • v2 20231017 JG.
  • REVIEWS
  • FITERED PAGES or PAGINATE
  • DUST
  • PERF MONITORING TOOL
  • INTERNAL SEARCH
  • XML Sitemaps
  • REVIEWS PAGINATION
  • INTERNAL SEARCH
  • STORE
  • Assistance pages
  • UPDATE ALTERNATE
  • Sorting - dec. 23
  • 2023-08-11 cldflr config
  • 2023-10-17 Majestic limit
  • 2024-03-29 FacebookBot limit
  • Block filtered listing pages

Warnings

  • 2 invalid lines.