elsoller.cat
robots.txt

Robots Exclusion Standard data for elsoller.cat

Resource Scan

Scan Details

Site Domain elsoller.cat
Base Domain elsoller.cat
Scan Status Ok
Last Scan2024-09-28T02:36:38+00:00
Next Scan 2024-10-05T02:36:38+00:00

Last Scan

Scanned2024-09-28T02:36:38+00:00
URL https://elsoller.cat/robots.txt
Redirect https://www.elsoller.cat/robots.txt
Redirect Domain www.elsoller.cat
Redirect Base elsoller.cat
Domain IPs 194.224.110.188
Redirect IPs 194.224.110.188
Response IP 194.224.110.188
Found Yes
Hash 2bca8cd9be62811ed213dc4b353fd864ee008656554f6d037823364c78cb0bb3
SimHash 792c5f73e694

Groups

*

Rule Path
Disallow /frontend_dev.php/
Disallow /frontend_nocache.php/
Disallow /backend.php/
Disallow /backend_dev.php/
Disallow /cron.php/
Disallow /cron_dev.php/
Disallow /sfCounter/*
Disallow /sfRating/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.elsoller.cat/sitemap.xml
sitemap https://www.elsoller.cat/googlenews.xml
sitemap https://www.elsoller.cat/image-sitemap.xml
sitemap https://www.elsoller.cat/autors.xml
sitemap https://www.elsoller.cat/noticies/sitemapIndex.xml

Comments

  • Yahoo's Slurp Robot - Please wait 15 seconds in between visits
  • MSN Robot - Please wait 15 seconds in between visits
  • Generales
  • Autores
  • Hemeroteca