buscalibre.com.co
robots.txt

Robots Exclusion Standard data for buscalibre.com.co

Resource Scan

Scan Details

Site Domain buscalibre.com.co
Base Domain buscalibre.com.co
Scan Status Ok
Last Scan2024-06-10T21:10:40+00:00
Next Scan 2024-07-10T21:10:40+00:00

Last Scan

Scanned2024-06-10T21:10:40+00:00
URL https://buscalibre.com.co/robots.txt
Redirect https://www.buscalibre.com.co/robots.txt
Redirect Domain www.buscalibre.com.co
Redirect Base buscalibre.com.co
Domain IPs 107.21.190.39, 52.200.76.122, 54.87.38.48
Redirect IPs 107.21.190.39, 52.200.76.122, 54.87.38.48
Response IP 107.21.190.39
Found Yes
Hash 7a31c9dd1daf42d8dd5eaaf00a4d2c7e9fd080c1894f5a39f181c60a2f7d23df
SimHash f57ec2f4ee50

Groups

*

Rule Path
Disallow /carro/*
Disallow /v2/*
Disallow /v2/u*
Disallow /v2/carro/*
Disallow /v2/pedido
Disallow /v2/iniciarPago
Disallow /v2/check*
Disallow /v2/autocomplete
Disallow /libros/search*?*
Disallow /books/search*?*
Disallow /tetraemos/*?*
Disallow /amazon*?*
Disallow /ebay*?*
Disallow /repuestos/search*
Disallow /*/zupa/search*
Disallow /anteojos?*
Disallow /manualidades?*
Allow /juegos-de-mesa?tag=juegos-de-mesa-envio-express
Disallow /juegos-de-mesa?*

*

Rule Path
Allow /
Disallow /product_a_awz.html*

*

Rule Path
Allow /
Disallow /libro/preview*

*

Rule Path
Allow /
Disallow /producto/stockupdate*

*

Rule Path
Allow /
Disallow /libros/biblio*

*

Rule Path
Allow /
Disallow /boton-*

adidum/1.0

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

brew-applet/0x20068888

Rule Path
Disallow /

cfnetwork/760.2.6

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

everyonesocialbot

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

exalead previewer

Rule Path
Disallow /

genieo/1.0

Rule Path
Disallow /

gigabot/1.0

Rule Path
Disallow /

go 1.1 package

Rule Path
Disallow /

grapeshotcrawler/2.0

Rule Path
Disallow /

httrack 3.0x

Rule Path
Disallow /

istellabot/1.23.15

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

nutch-1.10

Rule Path
Disallow /

nutch-1.7

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

ripper

Rule Path
Disallow /

safesearch microdata crawler

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

wbsearchbot/1.1

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

xenu link sleuth/1.3.8

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

curl

Rule Path
Disallow /

coccoc/1.0

Rule Path
Disallow /

heritrix/1.12.1

Rule Path
Disallow /

linkdexbot/2.2

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot-page

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

spbot/4.4.2

Rule Path
Disallow /%C2%A1

woobot/2.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.buscalibre.com.co/sitemap/com-co/sitemap.txt

Comments

  • Área interna del usuario y pasarela de pedidos y pagos
  • Bloquear filtrado de categorías
  • Bloquear búsquedas tetraemos
  • Búsqueda de repuestos
  • Zupa
  • Anteojos
  • Manualidades
  • Juegos de mesa
  • Otros
  • Users inutiles
  • bloqueo por pais
  • Ficheros Sitemap