cemea-pdll.org
robots.txt

Robots Exclusion Standard data for cemea-pdll.org

Resource Scan

Scan Details

Site Domain cemea-pdll.org
Base Domain cemea-pdll.org
Scan Status Ok
Last Scan2025-02-22T09:15:18+00:00
Next Scan 2025-03-24T09:15:18+00:00

Last Scan

Scanned2025-02-22T09:15:18+00:00
URL https://cemea-pdll.org/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:18, 213.186.33.18
Response IP 213.186.33.18
Found Yes
Hash 72f0cd99d8521fb85143c3743c88afe472ceb8187fed75e8b66478dc81adae08
SimHash 6b07de509f31

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Disallow /ecrire/
Disallow /lib/
Disallow /prive/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*
Disallow /*.api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://cemea-pdll.org/sitemap.xml

Comments

  • robots.txt
  • @url: https://cemea-pdll.org
  • @generator: SPIP 4.3.6
  • @template: squelettes-dist/robots.txt.html

Warnings

  • `noindex` is not a known field.