randstad.no
robots.txt

Robots Exclusion Standard data for randstad.no

Resource Scan

Scan Details

Site Domain randstad.no
Base Domain randstad.no
Scan Status Ok
Last Scan2024-06-16T22:36:06+00:00
Next Scan 2024-07-16T22:36:06+00:00

Last Scan

Scanned2024-06-16T22:36:06+00:00
URL https://randstad.no/robots.txt
Redirect https://www.randstad.no/robots.txt
Redirect Domain www.randstad.no
Redirect Base randstad.no
Domain IPs 108.157.254.34, 108.157.254.54, 108.157.254.62, 108.157.254.95
Redirect IPs 108.157.254.34, 108.157.254.54, 108.157.254.62, 108.157.254.95
Response IP 108.157.254.95
Found Yes
Hash 45289afce87894a3360678bd1b5a06e65e5f67148c5dd9eaa155986187cc2de5
SimHash 7d1dd216a2fa

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*ledige-stillinger/mvp/
Disallow /ledige-stillinger/*%2C*/
Disallow /*/?sortBy=*
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /ledige-stillinger/radius
Disallow /radius-search/
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/

Other Records

Field Value
sitemap https://www.randstad.no/sitemaps/sitemap.xml

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap