Log In Sign Up

cristianveloso.com
robots.txt

Robots Exclusion Standard data for cristianveloso.com

Resource Scan

Scan Details

Site Domain cristianveloso.com
Base Domain cristianveloso.com
Scan Status Ok
Last Scan2024-10-04T22:42:03+00:00
Next Scan 2024-10-11T22:42:03+00:00

Last Scan

Scanned2024-10-04T22:42:03+00:00
URL https://cristianveloso.com/robots.txt
Domain IPs 104.21.33.34, 172.67.158.128, 2606:4700:3032::6815:2122, 2606:4700:3034::ac43:9e80
Response IP 104.21.33.34
Found Yes
Hash 2b661e41ff9f673f26d4e57a3e70bbb9b9d049a83dbf7c5cdb5e4d3804c2f84e
SimHash 6af7b8d652be

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /*.sql$
Disallow /author/*
Disallow /acerca-de/*
Disallow /tag/*
Disallow /politica-privacidad/*
Disallow /*?
Disallow /?s=
Disallow /search
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback

googlebot

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /xmlrpc.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /*/xmlrpc.php
Disallow /*/wp-admin/
Disallow /*/wp-includes/
Disallow /*/wp-content/cache/
Back to top

Comments

  • Disallow:
  • Crawl-delay: 60 # 60 segundos entre cada request
  • Visit-time: 0300-1200 # 00:00 AM a 09:00 AM (America/Sao_Paulo)
  • Request-rate: 6/60m # permite indexar 6 documentos cada 60 minutos
  • Request-rate: 3/60m 1200-0300 # permite indexar 3 documentos cada 60 minutos entre las 09:00 AM a 00:00 AM (America/Sao_Paulo)
  • Bloquedo particulares
  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de trackbacks
  • Permitir Google Webmaster Tool
  • wordpress
  • Disallow: /wp-content/plugins/
  • Disallow: /wp-content/themes/
  • Disallow: /*/wp-content/plugins/
  • Disallow: /*/wp-content/themes/
Back to top