Log In Sign Up

pando.es
robots.txt

Robots Exclusion Standard data for pando.es

Resource Scan

Scan Details

Site Domain pando.es
Base Domain pando.es
Scan Status Ok
Last Scan2024-09-08T12:40:27+00:00
Next Scan 2024-10-08T12:40:27+00:00

Last Scan

Scanned2024-09-08T12:40:27+00:00
URL https://pando.es/robots.txt
Domain IPs 87.98.230.43
Response IP 87.98.230.43
Found Yes
Hash 963d9c803549e2742c9bd695a0bebca4a4d489e81a0699d7c25e93b13c690e1d
SimHash aa7476104830

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?s=
Disallow /search
Disallow /docs/
Disallow /pdf/
Disallow /PDF-INT2/
Disallow /PDFCAT/
Disallow /PandoNews_Descargas/
Disallow /energylabels/
Disallow /lavavajillas/
Disallow /docs/*.pdf$
Disallow /pdf/*.pdf$
Disallow /PDF-INT2/*.pdf$
Disallow /PDFCAT/*.pdf$
Disallow /PandoNews_Descargas/*.pdf$
Disallow /energylabels/*.pdf$
Disallow /lavavajillas/*.pdf$

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /
Allow /feed/$
Disallow /feed
Disallow /comments/feed
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Back to top

Other Records

Field Value
sitemap https://pando.es/sitemap_index.xml
Back to top

Comments

  • Reglas tipicas para WordPress
  • Bots chungos o que consumen ancho de banda
  • Permitimos el feed general para Google Blogsearch.
  • Impedimos que permalink/feed/ sea indexado ya que el
  • feed con los comentarios suele posicionarse en lugar de
  • la entrada y desorienta a los usuarios.
  • Lo mismo con URLs terminadas en /trackback/ que sólo
  • sirven como Trackback URI (y son contenido duplicado).
Back to top