thebar.com.mx
robots.txt

Robots Exclusion Standard data for thebar.com.mx

Resource Scan

Scan Details

Site Domain thebar.com.mx
Base Domain thebar.com.mx
Scan Status Ok
Last Scan2024-05-14T00:17:20+00:00
Next Scan 2024-06-13T00:17:20+00:00

Last Scan

Scanned2024-05-14T00:17:20+00:00
URL https://www.thebar.com.mx/robots.txt
Domain IPs 108.156.133.106, 108.156.133.16, 108.156.133.60, 108.156.133.79, 2600:9000:2755:4400:a:20b5:9b40:93a1, 2600:9000:2755:4c00:a:20b5:9b40:93a1, 2600:9000:2755:5600:a:20b5:9b40:93a1, 2600:9000:2755:8600:a:20b5:9b40:93a1, 2600:9000:2755:e000:a:20b5:9b40:93a1, 2600:9000:2755:e00:a:20b5:9b40:93a1, 2600:9000:2755:f200:a:20b5:9b40:93a1, 2600:9000:2755:f600:a:20b5:9b40:93a1
Response IP 108.156.133.79
Found Yes
Hash dd74dcee4834d3978490886c784a0caeb9a1462f6a81ec45311b6303345c4ac9
SimHash ec69b922a319

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /checkout*
Disallow /*?sku
Disallow /busca*
Disallow /quick-view*
Disallow /control*
Disallow /home
Disallow /lookbooks
Disallow /buscapagina*
Disallow /espiar*
Disallow /account*
Disallow /login*
Disallow /huichol
Disallow /*?*OrderByRelease*
Disallow /*?*OrderByScore*
Disallow /*?*q*
Disallow /*?*PS*
Disallow /*?*map*
Disallow /*?*idproduto*
Disallow /*?*KeepThis*
Disallow /*?*TB_iframe*
Disallow /*?*fq*
Disallow /*?*cc*
Disallow /*?*ciudad*
Disallow /*?*PageNumber*
Disallow /*?*sl*
Disallow /*?*sm*
Disallow /*?*IdImagen*
Disallow /*?*IdTipo*
Disallow /*?*Tamano*
Disallow /*?*TabId*
Disallow /*?*checkout*
Disallow /*?*ft*
Disallow /*?*iframe*
Disallow /*?*page*
Disallow /*?*PaginaAtual*
Disallow /*?*productId*
Disallow /*?*productLinkId*
Disallow /*?*ProductLinkNotFound*
Disallow /*?*ReturnUrl*
Disallow /*?*slash*
Disallow /*?*SortOrder*
Disallow /prueba

Other Records

Field Value
sitemap https://www.thebar.com.mx/sitemap.xml

Comments

  • Disallow URL Parameters