monster.fr
robots.txt

Robots Exclusion Standard data for monster.fr

Resource Scan

Scan Details

Site Domain monster.fr
Base Domain monster.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-04T08:42:12+00:00
Next Scan 2024-11-18T08:42:12+00:00

Last Successful Scan

Scanned2024-01-23T06:51:02+00:00
URL https://monster.fr/robots.txt
Redirect https://www.monster.fr/robots.txt
Redirect Domain www.monster.fr
Redirect Base monster.fr
Domain IPs 208.71.193.147, 208.71.199.147
Redirect IPs 18.155.68.12, 18.155.68.122, 18.155.68.128, 18.155.68.55
Response IP 3.162.38.60
Found Yes
Hash b0326ef4e8132c3a860533e8d95e6a0db2a00f6508120e05748fe1f5bdd2de77
SimHash 7cb2e1540102

Groups

*

Rule Path
Disallow */emploi/recherche*
Disallow */conseil-carriere/article?q=*
Disallow */conseil-carriere/article/GetResource*
Disallow /emploi/partager-une-offre
Disallow /emploi/offres-recommandees
Disallow /reviews
Disallow */Agents/
Disallow */apply/
Disallow */applyStart.asp
Disallow */become-member/
Disallow */columntemplatesearch
Disallow */Controls/
Disallow */default.aspx_Confirmation.evt
Disallow */DoNotAddToP4/UserControls/
Disallow */Error
Disallow */Error.aspx
Disallow */jbs/
Disallow */lpfsearch
Disallow */ManageSavedSearch
Disallow */services/
Disallow /cmslanding.aspx
Disallow /contact.
Disallow /profile/*
Disallow /wp-admin/

Other Records

Field Value
sitemap https://www.monster.fr/conseil-carriere/sitemap.xml
sitemap https://www.monster.fr/salaire/sitemap/sitemap_seo.xml
sitemap https://www.monster.fr/recruter/help_center-sitemap.xml
sitemap https://www.monster.fr/recruter/sitemap_index.xml
sitemap https://www.monster.fr/recruter/workforce_mgmt_tax-sitemap.xml
sitemap https://www.monster.fr/recruter/recruiting_strategy_category-sitemap.xml
sitemap https://www.monster.fr/recruter/conseil-en-ressources-humaines/sitemap_index.xml
sitemap https://www.monster.fr/recruter/blog-sitemap.xml
sitemap https://www.monster.fr/recruter/ebook-sitemap.xml
sitemap https://www.monster.fr/recruter/webinar-sitemap.xml
sitemap https://www.monster.fr/recruter/workforce_management-sitemap.xml
sitemap https://www.monster.fr/recruter/recruiting_strategy-sitemap.xml
sitemap https://www.monster.fr/lang-sitemap.xml
sitemap https://www.monster.fr/jobview-zuq65ljydx-fr.xml

Comments

  • 2023-12-19 17:01:30

Warnings

  • `sitmeap` is not a known field.