etudiant.lefigaro.fr
robots.txt

Robots Exclusion Standard data for etudiant.lefigaro.fr

Resource Scan

Scan Details

Site Domain etudiant.lefigaro.fr
Base Domain lefigaro.fr
Scan Status Ok
Last Scan2024-11-08T08:20:44+00:00
Next Scan 2024-11-15T08:20:44+00:00

Last Scan

Scanned2024-11-08T08:20:44+00:00
URL https://etudiant.lefigaro.fr/robots.txt
Domain IPs 104.18.4.96, 104.18.5.96, 2606:4700::6812:460, 2606:4700::6812:560
Response IP 104.18.5.96
Found Yes
Hash ae8dce797af35a5ec4af8a46e947e532ba18346e6281ff44f176422f26903054
SimHash 514494d6cdd3

Groups

*

Rule Path
Disallow /services/ecoles/recherche
Disallow /comment/*

Other Records

Field Value
sitemap https://etudiant.lefigaro.fr/sitemap_news.xml
sitemap https://etudiant.lefigaro.fr/sitemap_articles.xml
sitemap https://etudiant.lefigaro.fr/sitemap/

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • News
  • Articles
  • Annuaire