Log In Sign Up

colchonmorfeo.com
robots.txt

Robots Exclusion Standard data for colchonmorfeo.com

Resource Scan

Scan Details

Site Domain colchonmorfeo.com
Base Domain colchonmorfeo.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-10T08:01:51+00:00
Next Scan 2026-01-08T08:01:51+00:00

Last Successful Scan

Scanned2024-05-26T07:58:39+00:00
URL https://colchonmorfeo.com/robots.txt
Domain IPs 45.84.210.142
Response IP 45.84.210.142
Found Yes
Hash 8b3b6b400e4376d2f67f208160928b11aae0e726e8aedbb0a32f3b08ec66f50b
SimHash e0b059800cb2

Groups

googlebot-image

Rule Path
Allow /wp-content/uploads/
Allow /imagenes/

adsbot-google

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php

googlebot-mobile

Rule Path
Allow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /sitemap/
Disallow /author/
Disallow /?format=feed&type=rss
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /wp-comments
Disallow /cgi-bin
Disallow /trackback
Disallow /feed
Disallow /comments
Disallow /comment-page
Disallow /replytocom%3D
Disallow /author
Disallow /?author=
Disallow /tag
Disallow /?feed=
Disallow /?s=
Disallow /?se=
Disallow /prueba
Disallow *?replytocom
Disallow /?s=
Disallow /author/*/$
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Back to top

Other Records

Field Value
sitemap https://www.colchonmorfeo.com/sitemap.xml
Back to top

Comments

  • Permitir sitemap pero no las búsquedas.
  • Evita bloqueos de CSS y JS.
  • Lista de bots a permitir.
  • Lista de bots que generan consultas abusivas aunque siguen las pautas del archivo robots.txt
  • Indicamos que estas reglas son aplicables a todos los buscadores
  • Impedir que /permalink/feed/ sea indexado pues el feed de comentarios suele posicionarse antes de los post.
  • Impedir URLs terminadas en /trackback/ que sirven como Trackback URI (contenido duplicado).
Back to top

Warnings

  • 5 invalid lines.
  • `host` is not a known field.
Back to top