Log In Sign Up

randstad.co.nz
robots.txt

Robots Exclusion Standard data for randstad.co.nz

Resource Scan

Scan Details

Site Domain randstad.co.nz
Base Domain randstad.co.nz
Scan Status Ok
Last Scan2025-08-16T08:48:52+00:00
Next Scan 2025-08-30T08:48:52+00:00

Last Scan

Scanned2025-08-16T08:48:52+00:00
URL https://randstad.co.nz/robots.txt
Redirect https://www.randstad.co.nz/robots.txt
Redirect Domain www.randstad.co.nz
Redirect Base randstad.co.nz
Domain IPs 3.165.102.109, 3.165.102.11, 3.165.102.123, 3.165.102.77
Redirect IPs 2600:9000:2721:4600:b:41b9:90c0:93a1, 2600:9000:2721:7a00:b:41b9:90c0:93a1, 2600:9000:2721:9000:b:41b9:90c0:93a1, 2600:9000:2721:9c00:b:41b9:90c0:93a1, 2600:9000:2721:a00:b:41b9:90c0:93a1, 2600:9000:2721:cc00:b:41b9:90c0:93a1, 2600:9000:2721:ce00:b:41b9:90c0:93a1, 2600:9000:2721:f800:b:41b9:90c0:93a1, 3.165.102.109, 3.165.102.11, 3.165.102.123, 3.165.102.77
Response IP 3.165.102.11
Found Yes
Hash 486c08069ab2c23ec9912b341f66e292b10ca11cbfe537e21725b97bcd045c6f
SimHash 7115da13eaf2

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /jobs/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/
Disallow /sst/
Back to top

Other Records

Field Value
sitemap https://www.randstad.co.nz/sitemaps/sitemap.xml
Back to top

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • Exclude GTM URLs
  • XML Sitemap
Back to top