randstad.de
robots.txt

Robots Exclusion Standard data for randstad.de

Resource Scan

Scan Details

Site Domain randstad.de
Base Domain randstad.de
Scan Status Ok
Last Scan2024-11-06T09:53:23+00:00
Next Scan 2024-12-06T09:53:23+00:00

Last Scan

Scanned2024-11-06T09:53:23+00:00
URL https://randstad.de/robots.txt
Redirect https://www.randstad.de:443/robots.txt
Redirect Domain www.randstad.de
Redirect Base randstad.de
Domain IPs 34.252.209.58, 54.77.210.40
Redirect IPs 13.227.254.106, 13.227.254.81, 13.227.254.9, 13.227.254.91, 2600:9000:200a:2e00:19:9614:6080:93a1, 2600:9000:200a:3000:19:9614:6080:93a1, 2600:9000:200a:3400:19:9614:6080:93a1, 2600:9000:200a:7e00:19:9614:6080:93a1, 2600:9000:200a:8800:19:9614:6080:93a1, 2600:9000:200a:a000:19:9614:6080:93a1, 2600:9000:200a:d800:19:9614:6080:93a1, 2600:9000:200a:ee00:19:9614:6080:93a1
Response IP 13.227.254.91
Found Yes
Hash cac5940f52291fdbb6812a3486e6ec6b665e41a6d3f4370404d199fdfb31cbb1
SimHash 0d1cd85ee373

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /*/plz-
Disallow /*/k-
Disallow /*/s-
Disallow /*/br-
Disallow /*/cap-
Disallow /*/cm-
Disallow /*/cs-
Disallow /*/gb-
Disallow /*/cplz-
Disallow /*/ag-
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /jobs/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/gj-
Disallow /*/gm-
Disallow /*/gs-
Disallow /jobs/radius
Disallow /radius-search/
Disallow /*/apply/
Disallow /*/bewerben
Disallow /*/meine-bewerbungen/*
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /*/?c-themen
Disallow /*/?c-kategorie
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /*/danke
Disallow /danke
Disallow /*/manage-email-alerts/?uuid=*
Disallow /unternehmen/personalanfrage-*
Disallow /unternehmen/services/outplacement/risesmart-gkk*
Disallow /*/?password=*
Disallow /*/?userId=*
Disallow */api/*
Disallow /*/refresh-token/
Disallow /node/
Disallow /*/node/

gptbot

Rule Path
Disallow /karriere/
Disallow /hr-portal/

google-extended

Rule Path
Disallow /karriere/
Disallow /hr-portal/

Other Records

Field Value
sitemap https://www.randstad.de/sitemaps/sitemap.xml

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • Specific User Agents
  • GPTBot
  • Google-Extended
  • XML Sitemap