randstad.ca
robots.txt
Robots Exclusion Standard data for randstad.ca
Resource Scan
Scan Details
| Site Domain | randstad.ca |
| Base Domain | randstad.ca |
| Scan Status | Ok |
| Last Scan | 2024-09-08T01:15:08+00:00 |
| Next Scan | 2024-10-08T01:15:08+00:00 |
Last Scan
| Scanned | 2024-09-08T01:15:08+00:00 |
| URL | https://randstad.ca/robots.txt |
| Redirect | https://www.randstad.ca/robots.txt |
| Redirect Domain | www.randstad.ca |
| Redirect Base | randstad.ca |
| Domain IPs | 13.35.18.117, 13.35.18.123, 13.35.18.25, 13.35.18.36, 2600:9000:20c7:2200:8:a73:7300:93a1, 2600:9000:20c7:2c00:8:a73:7300:93a1, 2600:9000:20c7:2e00:8:a73:7300:93a1, 2600:9000:20c7:6a00:8:a73:7300:93a1, 2600:9000:20c7:7e00:8:a73:7300:93a1, 2600:9000:20c7:8200:8:a73:7300:93a1, 2600:9000:20c7:ac00:8:a73:7300:93a1, 2600:9000:20c7:e400:8:a73:7300:93a1 |
| Redirect IPs | 13.35.18.117, 13.35.18.123, 13.35.18.25, 13.35.18.36, 2600:9000:20c7:1000:8:a73:7300:93a1, 2600:9000:20c7:2a00:8:a73:7300:93a1, 2600:9000:20c7:4800:8:a73:7300:93a1, 2600:9000:20c7:4a00:8:a73:7300:93a1, 2600:9000:20c7:7a00:8:a73:7300:93a1, 2600:9000:20c7:7c00:8:a73:7300:93a1, 2600:9000:20c7:8800:8:a73:7300:93a1, 2600:9000:20c7:9000:8:a73:7300:93a1 |
| Response IP | 13.35.18.117 |
| Found | Yes |
| Hash | eafa7b4699250d8db9c8e166a8967df6a583cd3c54ba600b0d5e199079409f62 |
| SimHash | 31c46f53e168 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /core/*.css$ |
| Allow | /core/*.css? |
| Allow | /core/*.js$ |
| Allow | /core/*.js? |
| Allow | /core/*.gif |
| Allow | /core/*.jpg |
| Allow | /core/*.jpeg |
| Allow | /core/*.png |
| Allow | /core/*.svg |
| Allow | /profiles/*.css$ |
| Allow | /profiles/*.css? |
| Allow | /profiles/*.js$ |
| Allow | /profiles/*.js? |
| Allow | /profiles/*.gif |
| Allow | /profiles/*.jpg |
| Allow | /profiles/*.jpeg |
| Allow | /profiles/*.png |
| Allow | /profiles/*.svg |
| Disallow | /*/?c-career-advice |
| Disallow | /*/apply/ |
| Disallow | /myrandstad/auth/ |
| Disallow | /*/?c-category |
| Disallow | /*/?c-wf360-category |
| Disallow | /*/?c-tags |
| Disallow | /*/?c-press-category |
| Disallow | /*/mi- |
| Disallow | /*/km- |
| Disallow | /*/postcode- |
| Disallow | /*/sa- |
| Disallow | /*/qt- |
| Disallow | /*/d- |
| Disallow | /*search%3D |
| Disallow | /*search-app/demo/jobs/ |
| Disallow | /*jobs/mvp/ |
| Disallow | /*/profile- |
| Disallow | /*/jobs/*%2C*/ |
| Disallow | /*/sd- |
| Disallow | /*/sh- |
| Disallow | /*/sm- |
| Disallow | /*/?id=* |
| Disallow | /*/mpage- |
| Disallow | /*/auth/ |
| Disallow | /taxonomy/term/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.randstad.ca/sitemaps/sitemap.xml |
Comments