letudiant.fr
robots.txt

Robots Exclusion Standard data for letudiant.fr

Resource Scan

Scan Details

Site Domain letudiant.fr
Base Domain letudiant.fr
Scan Status Ok
Last Scan2024-05-26T13:09:32+00:00
Next Scan 2024-06-02T13:09:32+00:00

Last Scan

Scanned2024-05-26T13:09:32+00:00
URL https://www.letudiant.fr/robots.txt
Domain IPs 68.232.45.107
Response IP 68.232.45.107
Found Yes
Hash 3d6bb8d69fccba63fd8f9970836d256ba3e8decd69690b543c16424f21712a03
SimHash 632dc4b1615b

Groups

*

Rule Path
Disallow /hf.html
Disallow /hf/*
Disallow /etu/front
Disallow /annuaire/college/envoi_mail/
Disallow /evaluation/
Disallow /annuaire/
Disallow /static/uploads/etucmsCpsPlugin/
Disallow /recherche.html
Disallow /educpros/recherche.html
Disallow /trendy/recherche.html
Disallow /educpros/formulaire/inscription/*.html
Disallow /ajax/*
Disallow /ajax_*/*
Disallow /moteur/*
Disallow /fiches/etudes/fiche/www.letudiant.fr/ajax/recherche_osp_similar.html
Disallow /newsletter/*
Disallow /palmares/classement-lycees/*/*-asc.html
Disallow /palmares/classement-lycees/*/*-desc.html
Disallow /*/tri-*
Disallow /*/offres/*/date-*
Disallow /etudes/annuaire-enseignement-superieur/*?page=*
Disallow /components/
Disallow /modules/
Disallow /*/components/
Disallow /*/modules/
Disallow /resultat/candidat/*
Disallow /resultat/recherche.html
Disallow /compte/*/authentification.html
Disallow /compte/*/connexion.html
Disallow /compte/*/qualification.html
Disallow /educpros/recherche.html
Disallow /educpros/formulaire/inscription/*.html
Disallow /educpros/newsletter/derniere/*.html

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.letudiant.fr/sitemaps/letudiant/sitemap-index.xml.gz