Log In Sign Up

obspm.fr
robots.txt

Robots Exclusion Standard data for obspm.fr

Resource Scan

Scan Details

Site Domain obspm.fr
Base Domain obspm.fr
Scan Status Ok
Last Scan2024-06-15T15:56:33+00:00
Next Scan 2024-07-15T15:56:33+00:00

Last Scan

Scanned2024-06-15T15:56:33+00:00
URL https://obspm.fr/robots.txt
Redirect https://www.observatoiredeparis.psl.eu/robots.txt
Redirect Domain www.observatoiredeparis.psl.eu
Redirect Base psl.eu
Domain IPs 145.238.193.73
Redirect IPs 145.238.193.73
Response IP 145.238.193.73
Found Yes
Hash 67b41d8c0790d3a4351980b4b60bd0edd818e0da0da7036502fba5ebc1f4fc32
SimHash 2f039a108fb1

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Disallow /ecrire/
Disallow /lib/
Disallow /prive/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*
Disallow /*.api/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.observatoiredeparis.psl.eu/sitemap.xml
Back to top

Comments

  • robots.txt
  • @url: https://www.observatoiredeparis.psl.eu
  • @generator: SPIP 4.2.13 GIT [upgrade_debian10: ce4b5c4a]
  • @template: squelettes-dist/robots.txt.html
Back to top

Warnings

  • `noindex` is not a known field.
Back to top