laprensadesantacruz.info
robots.txt

Robots Exclusion Standard data for laprensadesantacruz.info

Resource Scan

Scan Details

Site Domain laprensadesantacruz.info
Base Domain laprensadesantacruz.info
Scan Status Ok
Last Scan2024-11-09T08:10:40+00:00
Next Scan 2024-11-16T08:10:40+00:00

Last Scan

Scanned2024-11-09T08:10:40+00:00
URL https://laprensadesantacruz.info/robots.txt
Domain IPs 104.21.77.253, 172.67.214.62, 2606:4700:3030::6815:4dfd, 2606:4700:3031::ac43:d63e
Response IP 172.67.214.62
Found Yes
Hash 7f4d8c2a00d3ee80ca52d335eb114d10c17fb3dd5ed6cd825c86f4eff9fee9d6
SimHash 6b7ed0f04264

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /admin/
Disallow /*.sql$
Disallow /*?
Disallow /?s=
Disallow /search
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback

Other Records

Field Value Comment
crawl-delay 60 60 segundos entre cada request

googlebot

Rule Path
Allow /*.js$
Allow /*.css$
Disallow /xmlrpc.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /*/xmlrpc.php
Disallow /*/wp-admin/
Disallow /*/wp-includes/
Disallow /*/wp-content/plugins/
Disallow /*/wp-content/cache/
Disallow /*/wp-content/themes/
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /*/administrator/
Disallow /*/bin/
Disallow /*/cache/
Disallow /*/cli/
Disallow /*/components/
Disallow /*/images/
Disallow /*/includes/
Disallow /*/installation/
Disallow /*/language/
Disallow /*/layouts/
Disallow /*/libraries/
Disallow /*/logs/
Disallow /*/media/
Disallow /*/modules/
Disallow /*/plugins/
Disallow /*/templates/
Disallow /*/tmp/

Comments

  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de trackbacks
  • Permitir Google Webmaster Tool
  • wordpress
  • joomla

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.