autobild.es
robots.txt

Robots Exclusion Standard data for autobild.es

Resource Scan

Scan Details

Site Domain autobild.es
Base Domain autobild.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-03T08:06:22+00:00
Next Scan 2024-10-02T08:06:22+00:00

Last Successful Scan

Scanned2024-06-05T06:56:38+00:00
URL https://autobild.es/robots.txt
Redirect https://www.autobild.es/robots.txt
Redirect Domain www.autobild.es
Redirect Base autobild.es
Domain IPs 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4
Redirect IPs 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4
Response IP 212.102.42.89
Found Yes
Hash 06553ab0eddc8099a391486950d9c6a5b574ffc9b3e05ca7e1bd40415a427cff
SimHash 58151718cf74

Groups

mediapartners-google

Rule Path
Disallow /noticias/calendario-erotico-liqui-moly-2016-270785
Disallow /galerias/calendario-erotico-liqui-moly-2016-270787

*

Rule Path
Allow /themes/autobild/css/style.css
Allow /themes/autobild/js/
Disallow /search/
Disallow /busqueda/
Disallow /buscar/
Disallow /buscador-coches/
Disallow /*/trackback/
Disallow /taxonomy/
Disallow /services/
Disallow /noticias/coche/
Disallow /noticias/coches/
Disallow /reportajes/%22https%3A/
Disallow /*/s.thebrighttag.com/
Disallow /*/www.facebook.com/
Disallow /*/es.linkedin.com/
Disallow /noticias/misc/
Disallow /*/google.com/
Disallow /noticias/ultimas-noticias/
Disallow /noticias/user/
Disallow /noticias/file%3A/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/all/modules/
Disallow /sites/all/themes/
Disallow /flipboard/
Disallow /user/login
Disallow /user/password
Disallow /user/register
Disallow /313092790/
Disallow /*/privacy
Disallow /*/eu-privacy
Disallow /*/service-privacy
Disallow /*/adroll
Disallow /*/ww.autobild.es/
Disallow /noticias/nokian-hakkapeliit
Disallow /noticias/signup
Disallow /noticias/puedes-comprarte-jaguar
Disallow /noticias/nuevo-coche-justin
Disallow /noticias/las-v..
Disallow /noticias/caterham-creara-un
Disallow /noticias/la-gasolina-alc
Disallow /noticias/abuelo-construye-l
Disallow /reportajes/null
Disallow /practicos/noeliaabe
Disallow /videos/noeliaabe
Disallow /fan-honda-civic
Disallow /motorsport/mad
Disallow /probador-neumaticos-bridgestone
Disallow /ab_head_foot/head
Disallow /ab_head_foot/foot
Disallow /*/www.pocketmath.com
Disallow /*/revealmobile.com
Disallow /*/www.liveramp.com
Disallow /*/www.indexexchange.com
Disallow /*/www.tresensa.com
Disallow /*/www.adsquare.com
Disallow /*/www.pocketmath.com
Disallow /*/delicast.com
Disallow /*/www.trefectamobility.com
Disallow /*/vuble.tv
Disallow /*/freewheel.tv
Disallow /*/privacy.audienceproject.com
Disallow /*/adrollgroup.com
Disallow /*/contenido_final
Disallow /*/seccion
Disallow /*/www.parsec.media
Disallow /*/components
Disallow /*/home
Disallow /*/otros/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /logout/
Disallow /node/add/
Disallow /user/*
Disallow /comment/
Disallow /coches-ocasion
Disallow /image_captcha/
Disallow /social-links/
Disallow /en/
Disallow /practicos/especiales/
Disallow /ab_social_links/
Disallow /bm-descriptor/
Disallow /content-types/
Disallow /car/
Disallow /offers/
Disallow /cars/
Disallow /products/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F

Other Records

Field Value
sitemap https://www.autobild.es/sitemap.xml
sitemap https://www.autobild.es/sitemap-video.xml
sitemap https://www.autobild.es/sitemap-image.xml
sitemap https://www.autobild.es/sitemapnews.xml
sitemap https://www.autobild.es/sitemap.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Paginas Disallow
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Sitemaps