menorca.info
robots.txt

Robots Exclusion Standard data for menorca.info

Resource Scan

Scan Details

Site Domain menorca.info
Base Domain menorca.info
Scan Status Ok
Last Scan2024-05-25T01:19:47+00:00
Next Scan 2024-06-01T01:19:47+00:00

Last Scan

Scanned2024-05-25T01:19:47+00:00
URL https://menorca.info/robots.txt
Redirect https://www.menorca.info/robots.txt
Redirect Domain www.menorca.info
Redirect Base menorca.info
Domain IPs 194.224.110.188
Redirect IPs 194.224.110.188
Response IP 194.224.110.188
Found Yes
Hash 0f530c9607bd676e5558b4fe670f4e5df89438d6b55143d23a3b586d255ed6d4
SimHash 792050104ed4

Groups

*

Rule Path
Disallow /cron.php/
Disallow /cron_dev.php/
Disallow /sfCounter/*
Disallow /sfRating/*
Disallow /sfRecommend/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.menorca.info/sitemap.xml
sitemap https://www.menorca.info/googlenews.xml
sitemap https://www.menorca.info/image-sitemap.xml
sitemap https://www.menorca.info/landings.xml
sitemap https://www.menorca.info/hilos.xml
sitemap https://www.menorca.info/autores.xml
sitemap https://www.menorca.info/noticias/sitemapIndex.xml
sitemap https://www.menorca.info/ocio.xml
sitemap https://www.menorca.info/cartelera.xml
sitemap https://www.menorca.info/fotogaleria.xml

Comments

  • Yahoo's Slurp Robot - Please wait 15 seconds in between visits
  • MSN Robot - Please wait 15 seconds in between visits
  • Generales
  • Landings
  • Secciones
  • Sitemap: https://www.menorca.info/guia_util.xml
  • Sitemap: https://www.menorca.info/especiales.xml
  • Autores
  • Hemeroteca
  • Ocio
  • Fotogalerias