reebok.co
robots.txt

Robots Exclusion Standard data for reebok.co

Resource Scan

Scan Details

Site Domain reebok.co
Base Domain reebok.co
Scan Status Ok
Last Scan2024-09-17T06:46:29+00:00
Next Scan 2024-10-17T06:46:29+00:00

Last Scan

Scanned2024-09-17T06:46:29+00:00
URL https://www.reebok.co/robots.txt
Domain IPs 13.35.185.102, 13.35.185.49, 13.35.185.63, 13.35.185.76, 2600:9000:2753:4c00:2:ba61:82c0:93a1, 2600:9000:2753:5200:2:ba61:82c0:93a1, 2600:9000:2753:600:2:ba61:82c0:93a1, 2600:9000:2753:6200:2:ba61:82c0:93a1, 2600:9000:2753:cc00:2:ba61:82c0:93a1, 2600:9000:2753:da00:2:ba61:82c0:93a1, 2600:9000:2753:dc00:2:ba61:82c0:93a1, 2600:9000:2753:e800:2:ba61:82c0:93a1
Response IP 108.157.254.100
Found Yes
Hash fbb63fa71b5a25ec7e90afb68879ab1713b8ff99fd4c55b651c00427af0a6936
SimHash ccd8cd035f96

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /account$
Disallow /login$
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

*

Rule Path
Allow /*.css
Allow /*.jpeg
Allow /*.js
Allow /*.png
Allow /*.webp
Allow /*.jpg
Allow /*.svg
Allow /*.woff
Allow /*.gif
Allow /*.ico
Disallow /*?
Allow /*?page=
Disallow /*/b$
Disallow /*/d$
Allow /*graphql
Allow /api/catalog_system/
Allow /api/dataentities/SF/search?_where=address
Allow /api/dataentities/WU/search?_where=rol
Allow /*arquivos/ids/*width%3D

*

Rule Path
Allow /*skuId%3D
Allow /*idsku%3D

Other Records

Field Value
sitemap https://www.reebok.co/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.
  • ALLOWs QUE DEBEN ESTAR SIEMPRE
  • URLS NO DEBEN APARECER
  • Urls rastreables
  • vtexassets RASTREABLES IMG
  • ALLOW URL PARAMETROS: IMPORTANTE MERCHANT
  • SITEMAPS
  • -
  • =
  • *
  • *
  • +. =####=
  • : #####+
  • = :
  • +=+
  • +
  • +...#*-...:*##*-...:+##########*
  • = = += +
  • = -++= :+*=. .
  • = =####= -####+ +
  • = *####+ *####* +
  • = #####+ *####* +
  • =######= #####+ *####* +
  • = #####+ *####* +
  • = #####+ *####* +
  • = #####+ *####* +
  • +####+---#####*---*#####---*
  • *
  • -
  • *
  • -#################*
  • =