randstad.at
robots.txt

Robots Exclusion Standard data for randstad.at

Resource Scan

Scan Details

Site Domain randstad.at
Base Domain randstad.at
Scan Status Ok
Last Scan2024-08-25T21:34:23+00:00
Next Scan 2024-09-24T21:34:23+00:00

Last Scan

Scanned2024-08-25T21:34:23+00:00
URL https://randstad.at/robots.txt
Redirect https://www.randstad.at/robots.txt
Redirect Domain www.randstad.at
Redirect Base randstad.at
Domain IPs 13.33.88.101, 13.33.88.122, 13.33.88.62, 13.33.88.94, 2600:9000:223b:1400:b:36e5:1440:93a1, 2600:9000:223b:2200:b:36e5:1440:93a1, 2600:9000:223b:2800:b:36e5:1440:93a1, 2600:9000:223b:3800:b:36e5:1440:93a1, 2600:9000:223b:4000:b:36e5:1440:93a1, 2600:9000:223b:4800:b:36e5:1440:93a1, 2600:9000:223b:8000:b:36e5:1440:93a1, 2600:9000:223b:9a00:b:36e5:1440:93a1
Redirect IPs 13.33.88.101, 13.33.88.122, 13.33.88.62, 13.33.88.94, 2600:9000:223b:3a00:b:36e5:1440:93a1, 2600:9000:223b:4200:b:36e5:1440:93a1, 2600:9000:223b:4400:b:36e5:1440:93a1, 2600:9000:223b:8600:b:36e5:1440:93a1, 2600:9000:223b:8a00:b:36e5:1440:93a1, 2600:9000:223b:a600:b:36e5:1440:93a1, 2600:9000:223b:b600:b:36e5:1440:93a1, 2600:9000:223b:d000:b:36e5:1440:93a1
Response IP 13.33.88.122
Found Yes
Hash 892e6583bb136393ac4d28fdf393bee484dcf998177b86e397a3895e71d15ed9
SimHash b91d9a12ebf0

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /jobs/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/apply/
Disallow /*/bewerben/
Disallow /*/?c-career-advice
Disallow /*/job-details-redirect/
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/

Other Records

Field Value
sitemap https://www.randstad.at/sitemaps/sitemap.xml

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap