randstad.com
robots.txt
Robots Exclusion Standard data for randstad.com
Resource Scan
Scan Details
| Site Domain | randstad.com |
| Base Domain | randstad.com |
| Scan Status | Ok |
| Last Scan | 2024-08-28T10:50:26+00:00 |
| Next Scan | 2024-09-27T10:50:26+00:00 |
Last Scan
| Scanned | 2024-08-28T10:50:26+00:00 |
| URL | https://randstad.com/robots.txt |
| Redirect | https://www.randstad.com/robots.txt |
| Redirect Domain | www.randstad.com |
| Redirect Base | randstad.com |
| Domain IPs | 18.155.68.19, 18.155.68.20, 18.155.68.35, 18.155.68.52, 2600:9000:23d2:5c00:0:9a73:1ac0:93a1, 2600:9000:23d2:6000:0:9a73:1ac0:93a1, 2600:9000:23d2:7800:0:9a73:1ac0:93a1, 2600:9000:23d2:8200:0:9a73:1ac0:93a1, 2600:9000:23d2:bc00:0:9a73:1ac0:93a1, 2600:9000:23d2:c00:0:9a73:1ac0:93a1, 2600:9000:23d2:cc00:0:9a73:1ac0:93a1, 2600:9000:23d2:e000:0:9a73:1ac0:93a1 |
| Redirect IPs | 18.155.68.19, 18.155.68.20, 18.155.68.35, 18.155.68.52 |
| Response IP | 18.155.68.35 |
| Found | Yes |
| Hash | d4deb6b1c8f77e516d4474c5f6edbcf96f98d65f8490f11fa78f45953679d6a1 |
| SimHash | 551dda16e378 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*/km- |
| Disallow | /*/postcode- |
| Disallow | /*/sa- |
| Disallow | /*/qt- |
| Disallow | /*search%3D |
| Disallow | /*search-app/demo/jobs/ |
| Disallow | /*jobs/mvp/ |
| Disallow | /jobs/*%2C*/ |
| Disallow | /*/mpage- |
| Disallow | /*/apply/ |
| Disallow | /*/?c-career-advice |
| Disallow | /*/?c-category |
| Disallow | /*/?c-wf360-category |
| Disallow | /*/?c-tags |
| Disallow | /*/?c-press-category |
| Disallow | /*/profile- |
| Disallow | /node/ |
| Disallow | /*/node/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.randstad.com/sitemaps/sitemap.xml |
Comments