emploi.lefigaro.fr
robots.txt
Robots Exclusion Standard data for emploi.lefigaro.fr
Resource Scan
Scan Details
| Site Domain | emploi.lefigaro.fr |
| Base Domain | lefigaro.fr |
| Scan Status | Ok |
| Last Scan | 2024-05-01T21:59:41+00:00 |
| Next Scan | 2024-05-31T21:59:41+00:00 |
Last Scan
| Scanned | 2024-05-01T21:59:41+00:00 |
| URL | https://emploi.lefigaro.fr/robots.txt |
| Domain IPs | 104.18.6.195, 104.18.7.195, 2606:4700::6812:6c3, 2606:4700::6812:7c3 |
| Response IP | 104.18.6.195 |
| Found | Yes |
| Hash | cb9aacaef1a7f745bbc660ddee778c49a2092c13af20d2657a220cfac462f587 |
| SimHash | 13d54a4444d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /recherche/entreprises?q* |
| Disallow | /entreprises/s/*/*/*?page= |
| Disallow | /generateur-cv |
| Disallow | /offres-emploi/redirect/* |
| Disallow | /cdn-cgi/ |
| Disallow | /*gbt%3D* |
| Disallow | /metiers/recherche?* |
| Disallow | /recherche/offres-emploi?q=* |
| Disallow | /services/poi?location=* |
| Disallow | /services/fca_tracker/jobViewTracking |
| Disallow | /services/search/similar-companies?apeCode=* |
| Disallow | /services/feature/datadriven |
| Disallow | /services/search/jobs |
| Disallow | /services/search/cities?size=* |
| Disallow | /*utm%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://emploi.lefigaro.fr/sitemap.xml |
| sitemap | https://emploi.lefigaro.fr/sitemap-offres-regions-secteurs.xml |
| sitemap | https://emploi.lefigaro.fr/sitemap/ |