emploi.lefigaro.fr
robots.txt
Robots Exclusion Standard data for emploi.lefigaro.fr
Resource Scan
Scan Details
| Site Domain | emploi.lefigaro.fr |
| Base Domain | lefigaro.fr |
| Scan Status | Ok |
| Last Scan | 2024-10-28T23:37:55+00:00 |
| Next Scan | 2024-11-27T23:37:55+00:00 |
Last Scan
| Scanned | 2024-10-28T23:37:55+00:00 |
| URL | https://emploi.lefigaro.fr/robots.txt |
| Domain IPs | 104.18.6.195, 104.18.7.195, 2606:4700::6812:6c3, 2606:4700::6812:7c3 |
| Response IP | 104.18.7.195 |
| Found | Yes |
| Hash | 46a7c12e793db9b915570017251603776418dad886ebd1c83f99217a64145b72 |
| SimHash | 315d4a4440d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /recherche/entreprises?q* |
| Disallow | /entreprises/s/*/*/*?page= |
| Disallow | /generateur-cv |
| Disallow | /offres-emploi/redirect/* |
| Disallow | /cdn-cgi/ |
| Disallow | /*gbt%3D* |
| Disallow | /metiers/recherche?* |
| Disallow | /recherche/offres-emploi?q=* |
| Disallow | /services/poi?location=* |
| Disallow | /services/fca_tracker/jobViewTracking |
| Disallow | /services/search/similar-companies?apeCode=* |
| Disallow | /services/feature/datadriven |
| Disallow | /services/search/jobs |
| Disallow | /services/search/cities?size=* |
| Disallow | /*utm%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://emploi.lefigaro.fr/sitemap.xml |