departement18.fr
robots.txt

Robots Exclusion Standard data for departement18.fr

Resource Scan

Scan Details

Site Domain departement18.fr
Base Domain departement18.fr
Scan Status Ok
Last Scan5/21/2025, 7:47:05 AM
Next Scan 6/20/2025, 7:47:05 AM

Last Scan

Scanned5/21/2025, 7:47:05 AM
URL https://departement18.fr/robots.txt
Redirect https://www.departement18.fr/robots.txt
Redirect Domain www.departement18.fr
Redirect Base departement18.fr
Domain IPs 213.182.41.202
Redirect IPs 87.98.187.73
Response IP 87.98.187.73
Found Yes
Hash 07bd4f6c77a21f81ff3c04ebdfe1370b6dc4727af9b53d30fa05a0f334f879a1
SimHash 2b029a70abb1

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Disallow /ecrire/
Disallow /lib/
Disallow /prive/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*
Disallow /*.api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.departement18.fr/sitemap.xml

Comments

  • robots.txt
  • @url: https://www.departement18.fr
  • @template: plugins/auto/entravaux/v5.2.0/robots.txt.html

Warnings

  • `noindex` is not a known field.