Log In Sign Up

randstad.lu
robots.txt

Robots Exclusion Standard data for randstad.lu

Resource Scan

Scan Details

Site Domain randstad.lu
Base Domain randstad.lu
Scan Status Ok
Last Scan2024-06-30T00:00:39+00:00
Next Scan 2024-07-30T00:00:39+00:00

Last Scan

Scanned2024-06-30T00:00:39+00:00
URL https://randstad.lu/robots.txt
Redirect https://www.randstad.lu/robots.txt
Redirect Domain www.randstad.lu
Redirect Base randstad.lu
Domain IPs 13.33.88.16, 13.33.88.27, 13.33.88.40, 13.33.88.43
Redirect IPs 13.33.88.16, 13.33.88.27, 13.33.88.40, 13.33.88.43, 2600:9000:2488:2c00:16:85e0:7a00:93a1, 2600:9000:2488:3600:16:85e0:7a00:93a1, 2600:9000:2488:4600:16:85e0:7a00:93a1, 2600:9000:2488:9000:16:85e0:7a00:93a1, 2600:9000:2488:b600:16:85e0:7a00:93a1, 2600:9000:2488:b800:16:85e0:7a00:93a1, 2600:9000:2488:f400:16:85e0:7a00:93a1, 2600:9000:2488:fe00:16:85e0:7a00:93a1
Response IP 13.33.88.27
Found Yes
Hash 1a91e3572e30a7b945529594c213527e0aa36bb38c7b182da8201f025f2bda3a
SimHash 780dd013a2fa

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /emplois/*%2C*/
Disallow /en/jobs/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /emplois/radius
Disallow /en/jobs/radius
Disallow /radius-search/
Disallow /*/radius-search/
Disallow /emplois/postuler/
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /en/taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/
Back to top

Other Records

Field Value
sitemap https://www.randstad.lu/sitemaps/sitemap.xml
Back to top

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap
Back to top