Log In Sign Up

fernandomiro.com
robots.txt

Robots Exclusion Standard data for fernandomiro.com

Resource Scan

Scan Details

Site Domain fernandomiro.com
Base Domain fernandomiro.com
Scan Status Ok
Last Scan2026-02-19T10:28:54+00:00
Next Scan 2026-03-21T10:28:54+00:00

Last Scan

Scanned2026-02-19T10:28:54+00:00
URL https://fernandomiro.com/robots.txt
Domain IPs 213.158.93.54
Response IP 213.158.93.54
Found Yes
Hash b8902eaa1f5880c267b65664becec271b791106aeb7c70b540e73ecdfe4d5e49
SimHash 6850d692c652

Groups

oai-searchbot

Rule Path
Allow /

oai-user-agent

Rule Path
Allow /

*

Rule Path
Disallow /cgi-bin
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /*?
Allow /index.php?sitemap=1
Disallow /index.php
Disallow /*.php$
Disallow /*.inc$
Disallow /page/
Disallow /tag/
Disallow /category/
Disallow /_index_ssl.html_gzip/
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /amp/*/page/
Disallow /*/amp
Disallow */page/
Allow /wp-content/uploads/$
Allow /wp-content/ewww/lazy/$
Allow /wp-content/themes/$
Allow /wp-content/themes/$
Allow /wp-content/litespeed/$
Allow /wp-content/*/*/*/*.js
Allow /wp-content/*/*/*/*.css
Allow /wp-content/*/*/*.js
Allow /wp-content/*/*/*.css
Allow /wp-content/*/*.js
Allow /wp-content/*/*.css
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*/*/*/*.js
Allow /wp-includes/*/*/*/*.css
Allow /wp-includes/*/*/*.js
Allow /wp-includes/*/*/*.css
Allow /wp-includes/*/*.js
Allow /wp-includes/*/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /feed/
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/*/feed/$
Disallow /*/*/*/feed/$
Disallow /*/page/$
Disallow /*/*/page/$
Disallow /*/*/*/page/$
Disallow /*/feed/rss/$
Disallow /*/*/feed/rss/$
Disallow /*/*/*/feed/rss/$
Disallow /trackback/
Disallow /*/trackback/$
Disallow /*/*/trackback/$
Disallow /*/*/*/trackback/$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /cdn-cgi/
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.jpg.webp$
Allow /*.gif$
Allow /*.png$
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.docx$

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

libwww

Rule Path
Disallow /

slurp

Rule Path
Disallow /gracias-por-contactar/
Disallow /gracias-por-contactar-modulos/
Disallow /404-2/

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.fernandomiro.com/sitemap_index.xml
Back to top

Comments

  • Permitir al bot de OpenAI (ChatGPT Search)
  • Disallow: /wp-
  • Disallow: /wp-content/
  • Bloqueo de URLs con parámetros
  • Otros Bloqueos y permisos
  • Impedir el acceso a los diferentes feed que genere la página
  • Impedir URLs terminadas en /trackback/ que sirven como Trackback URL
  • Bloquear por tipos de ficheros
  • Evita bloqueos de CSS y JS e imágenes
  • Lista de bots bloqueados
  • Desautorizar a paginas con menor valor de seo
  • Sitemap
Back to top