Log In Sign Up

compartir-tecnologias.es
robots.txt

Robots Exclusion Standard data for compartir-tecnologias.es

Resource Scan

Scan Details

Site Domain compartir-tecnologias.es
Base Domain compartir-tecnologias.es
Scan Status Ok
Last Scan2024-05-30T04:37:16+00:00
Next Scan 2024-06-06T04:37:16+00:00

Last Scan

Scanned2024-05-30T04:37:16+00:00
URL https://compartir-tecnologias.es/robots.txt
Redirect https://www.compartir-tecnologias.es/robots.txt
Redirect Domain www.compartir-tecnologias.es
Redirect Base compartir-tecnologias.es
Response IP 51.178.73.217
Found Yes
Hash a9fb44b5120e2bbe4eec486abd5c9c9f58e6f2ca19a15c7034ce1c6548862ba7
SimHash 6168de46a61b

Groups

mediapartners-google

Rule Path
Disallow

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /divers/
Disallow /inc/
Disallow /vistaprevia/
Disallow /redireccion.html
Disallow /buscador/
Disallow /*?follow
Back to top

Other Records

Field Value
sitemap http://www.compartir-tecnologias.es/sitemap.xml
sitemap http://www.compartir-tecnologias.es/sitemap_ayuda.xml
Back to top

Comments

  • SEO indexer
  • previsu entraide
  • redirections
  • recherche formulaire
  • recherche avancee
  • Disallow: /*?adv
  • Disallow: /*&adv
  • recherche categorie
  • Disallow: /s/prensa/
  • Disallow: /s/ayuda/
  • Disallow: /s/videos/
  • lien pour alertes topic
Back to top