Log In Sign Up

imusahomeandcook.com
robots.txt

Robots Exclusion Standard data for imusahomeandcook.com

Resource Scan

Scan Details

Site Domain imusahomeandcook.com
Base Domain imusahomeandcook.com
Scan Status Ok
Last Scan2024-09-17T04:38:02+00:00
Next Scan 2024-10-17T04:38:02+00:00

Last Scan

Scanned2024-09-17T04:38:02+00:00
URL https://imusahomeandcook.com/robots.txt
Redirect https://www.imusa.com.co/robots.txt
Redirect Domain www.imusa.com.co
Redirect Base imusa.com.co
Domain IPs 152.89.172.56, 2a01:c8:100::54, 2a01:c8:101::55, 2a09:35c0:102::56, 81.92.94.54, 81.92.95.55
Redirect IPs 13.33.88.125, 13.33.88.41, 13.33.88.66, 13.33.88.70, 2600:9000:223b:1800:7:7c8b:ee80:93a1, 2600:9000:223b:2a00:7:7c8b:ee80:93a1, 2600:9000:223b:5e00:7:7c8b:ee80:93a1, 2600:9000:223b:800:7:7c8b:ee80:93a1, 2600:9000:223b:ba00:7:7c8b:ee80:93a1, 2600:9000:223b:be00:7:7c8b:ee80:93a1, 2600:9000:223b:c00:7:7c8b:ee80:93a1, 2600:9000:223b:c800:7:7c8b:ee80:93a1
Response IP 13.33.88.125
Found Yes
Hash 1a55ab8d3ac72c1e1b55448957854552d10f6bb2fd8c52d16e9f97ae8517a562
SimHash ccd8e5235fd7

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /account$
Disallow /login$
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

*

Rule Path
Allow /*.css
Allow /*.jpeg
Allow /*.js
Allow /*.png
Allow /*.webp
Allow /*.jpg
Allow /*.svg
Allow /*.woff
Allow /*.gif
Allow /*.ico
Disallow /*?
Allow /*?page=
Disallow /*/b$
Disallow /*/d$
Allow /*graphql
Allow /api/catalog_system/
Allow /api/dataentities/SF/search?_where=address
Allow /api/dataentities/WU/search?_where=rol
Allow /*arquivos/ids/*width%3D

*

Rule Path
Allow /*skuId%3D
Allow /*idsku%3D
Back to top

Other Records

Field Value
sitemap https://www.imusa.com.co/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
  • ALLOWs QUE DEBEN ESTAR SIEMPRE
  • URLS NO DEBEN APARECER
  • Urls rastreables
  • vtexassets RASTREABLES IMG
  • ALLOW URL PARAMETROS: IMPORTANTE MERCHANT
  • SITEMAPS
Back to top