probelleza.es
robots.txt

Robots Exclusion Standard data for probelleza.es

Resource Scan

Scan Details

Site Domain probelleza.es
Base Domain probelleza.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-21T18:55:18+00:00
Next Scan 2026-01-20T18:55:18+00:00

Last Successful Scan

Scanned2025-10-29T23:19:51+00:00
URL https://probelleza.es/robots.txt
Domain IPs 213.158.86.25
Response IP 213.158.86.25
Found Yes
Hash 67de2797478818bc62ed9e912db9fc77e5f6177f2124859522ebb30b2bcfdec0
SimHash a3423ed24cb5

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /carrito/
Disallow /finalizar-compra/
Disallow /mi-cuenta/
Disallow /*add-to-cart%3D*
Disallow /?s=
Disallow /search
Disallow /search-results
Disallow /*dgwt_wcas%3D*
Allow /wp-content/uploads/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://probelleza.es/sitemap.xml

Comments

  • Zonas de WooCommerce que no deben rastrearse
  • Búsquedas
  • Permitir recursos para renderizado
  • (No bloqueamos plugins/themes/includes para evitar problemas de render)
  • Bots ruidosos (opcional, solo si te dan guerra)