periodicodeibiza.es
robots.txt

Robots Exclusion Standard data for periodicodeibiza.es

Resource Scan

Scan Details

Site Domain periodicodeibiza.es
Base Domain periodicodeibiza.es
Scan Status Ok
Last Scan2024-06-01T18:00:13+00:00
Next Scan 2024-06-08T18:00:13+00:00

Last Scan

Scanned2024-06-01T18:00:13+00:00
URL https://periodicodeibiza.es/robots.txt
Redirect https://www.periodicodeibiza.es/robots.txt
Redirect Domain www.periodicodeibiza.es
Redirect Base periodicodeibiza.es
Domain IPs 194.224.110.188
Redirect IPs 194.224.110.188
Response IP 194.224.110.188
Found Yes
Hash a5ab09d06503af7e8e507bc02981dc211e475bf2e05c3344c1ff1f1f29dc7c64
SimHash 7b04c5932a94

Groups

*

Rule Path
Disallow /cron.php/
Disallow /cron_dev.php/
Disallow /sfCounter/*
Disallow /sfRating/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.periodicodeibiza.es/sitemap.xml
sitemap https://www.periodicodeibiza.es/googlenews.xml
sitemap https://www.periodicodeibiza.es/image-sitemap.xml
sitemap https://www.menorca.info/landings.xml
sitemap https://www.menorca.info/hilos.xml
sitemap https://www.periodicodeibiza.es/autores.xml
sitemap https://www.periodicodeibiza.es/noticias/sitemapIndex.xml
sitemap https://www.periodicodeibiza.es/comer_y_beber.xml
sitemap https://www.periodicodeibiza.es/cartelera.xml
sitemap https://www.periodicodeibiza.es/sorteos.xml
sitemap https://www.periodicodeibiza.es/fotogaleria.xml

Comments

  • Yahoo's Slurp Robot - Please wait 15 seconds in between visits
  • MSN Robot - Please wait 15 seconds in between visits
  • Generales
  • Landings
  • Autores
  • Hemeroteca
  • Ocio
  • Sorteos
  • Media