Log In Sign Up

juegosabiertos.com
robots.txt

Robots Exclusion Standard data for juegosabiertos.com

Resource Scan

Scan Details

Site Domain juegosabiertos.com
Base Domain juegosabiertos.com
Scan Status Ok
Last Scan2024-10-31T23:44:56+00:00
Next Scan 2024-11-07T23:44:56+00:00

Last Scan

Scanned2024-10-31T23:44:56+00:00
URL https://juegosabiertos.com/robots.txt
Domain IPs 104.21.8.69, 172.67.138.164, 2606:4700:3037::6815:845, 2606:4700:3037::ac43:8aa4
Response IP 172.67.138.164
Found Yes
Hash 2c8baf054a2ce7a48e4b52d9f70257112c8b1758a2f8b270e8388e8b994679d7
SimHash a8d67a4ac8f5

Groups

*

Rule Path
Allow /*.css$
Allow /*.js$
Disallow /uploads/
Disallow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/upgrade/
Disallow /wp-includes/
Disallow /login/
Disallow /trackback/
Disallow /wp-admin/
Disallow /sin-categoria/
Disallow /vinilos/
Disallow /rating_over/
Disallow /archives/
Disallow /cgi-bin/
Disallow /shop/
Disallow /tienda/
Disallow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /?s=
Disallow /search
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*?*
Disallow /author/
Disallow /tag/
Disallow /*/page/$
Disallow /*/*/page/$
Disallow /*/pages/$
Disallow /*/*/pages/$
Disallow /territoriodeninos_d/
Disallow /pirineos/
Disallow /jugaresgratis_1/
Disallow /niceto*
Disallow /intercambios/
Disallow /foro/
Disallow /foro-simsbit/
Disallow /iconos/
Disallow /juegosflash/
Disallow /pphlogger/
Disallow /pirineos/
Allow /*/wp-content/uploads/
Disallow /*/feed/$
Disallow /*/wp-
Disallow /*/wp-content/
Disallow /*/trackback/
Disallow /*/wp-admin/
Disallow /*/feed/
Disallow /*/?s=
Disallow /*/search
Disallow /*/archives/
Disallow /*/index.php
Disallow /*/*?
Disallow /*/*.php$
Disallow /*/*.js$
Disallow /*/*.inc$
Disallow /*/*.css$
Disallow /*/*/feed/
Disallow /*/trackback/
Disallow /*/page/
Disallow /*/tag/
Disallow /*/category/
Disallow /*/wp-includes/
Disallow /*/login/
Disallow /*/sin-categoria/
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$

googlebot
mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /wp-includes/
Allow /wp-content/uploads/
Allow /imagenes/
Allow /
Disallow */wp-includes/
Allow */wp-content/uploads/

msnbot

Rule Path
Allow /

yahoobot

Rule Path
Allow /

teoma

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/*
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /cgi-bin
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /*/attachment/
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /page/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /?attachment_id*
Disallow /*?

*

Rule Path
Disallow /?s=
Disallow /search

*

Rule Path
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Back to top

Other Records

Field Value
sitemap https://juegosabiertos.com/sitemap_index.xml
sitemap https://juegosabiertos.com/post-sitemap.xml
sitemap https://juegosabiertos.com/page-sitemap.xml
sitemap https://juegosabiertos.com/juegosonline/sitemap_index.xml
sitemap https://juegosabiertos.com/juegosonline/post-sitemap.xml
sitemap https://juegosabiertos.com/juegosonline/category-sitemap.xml
sitemap https://juegosabiertos.com/juegosonline/page-sitemap.xml
Back to top

Comments

  • No indexar copias de seguridad
  • Permitir bot de Adsense. Opcional, pero recomedable si lo usamos.
  • Permitir a Google Imagenes indexar nuestras imagenes. Opcional.
  • Bloqueo basico para todos los bots y crawlers
  • puede dar problemas por bloqueo de recursos en GWT
  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de trackbacks
  • Bloqueo de feeds para crawlers
  • Ralentizamos algunos bots que se suelen volver locos
  • Bloqueo de bots y crawlers poco utiles
  • Previene problemas de recursos bloqueados en Google Webmaster Tools
Back to top