Log In Sign Up

adictivo365.com
robots.txt

Robots Exclusion Standard data for adictivo365.com

Resource Scan

Scan Details

Site Domain adictivo365.com
Base Domain adictivo365.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-07-11T19:44:57+00:00
Next Scan 2024-10-09T19:44:57+00:00

Last Successful Scan

Scanned2024-03-14T19:09:40+00:00
URL https://adictivo365.com/robots.txt
Domain IPs 168.195.128.179, 2803:3b80:11:58::1000
Response IP 168.195.128.179
Found Yes
Hash 72ec551a8e78c50274cd21fd093ab71e06118cc5610e230c6cd21d205a8b914a
SimHash a4f6cb84047b

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /cgi-bin
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /wp-
Disallow /?s=
Disallow /search
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow ///feed/$
Disallow ///feed/rss/$
Disallow ///trackback/$
Disallow ///*/feed/$
Disallow ///*/feed/rss/$
Disallow ///*/trackback/$
Allow /*.js$
Allow /*.css$

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.adictivo365.com/sitemap.xml
Back to top

Comments

  • robots.txt para un blog WordPress.
  • Bloquear o permitir acceso a contenido adjunto. (Si la instalación está en /public_html).
  • Desindexar carpetas que empiecen por wp-
  • Permitir sitemap pero no las búsquedas.
  • Permitir Feed general para Google Blogsearch.
  • Impedir que /permalink/feed/ sea indexado pues el feed de comentarios suele posicionarse antes de los post.
  • Impedir URLs terminadas en /trackback/ que sirven como Trackback URI (contenido duplicado).
  • Evita bloqueos de CSS y JS.
  • Lista de bots que deberías permitir.
  • Lista de bots que generan consultas abusivas aunque siguen las pautas del archivo robots.txt
Back to top