randstadrisesmart.co.uk
robots.txt
Robots Exclusion Standard data for randstadrisesmart.co.uk
Resource Scan
Scan Details
| Site Domain | randstadrisesmart.co.uk |
| Base Domain | randstadrisesmart.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-08T08:00:46+00:00 |
| Next Scan | 2024-07-08T08:00:46+00:00 |
Last Scan
| Scanned | 2024-06-08T08:00:46+00:00 |
| URL | https://randstadrisesmart.co.uk/robots.txt |
| Redirect | https://www.randstadenterprise.com/robots.txt |
| Redirect Domain | www.randstadenterprise.com |
| Redirect Base | randstadenterprise.com |
| Domain IPs | 54.220.254.242, 54.75.224.211 |
| Redirect IPs | 18.155.68.100, 18.155.68.48, 18.155.68.69, 18.155.68.89, 2600:9000:23d2:1800:18:14e6:a840:93a1, 2600:9000:23d2:5200:18:14e6:a840:93a1, 2600:9000:23d2:6000:18:14e6:a840:93a1, 2600:9000:23d2:7200:18:14e6:a840:93a1, 2600:9000:23d2:9000:18:14e6:a840:93a1, 2600:9000:23d2:a600:18:14e6:a840:93a1, 2600:9000:23d2:b400:18:14e6:a840:93a1, 2600:9000:23d2:da00:18:14e6:a840:93a1 |
| Response IP | 18.155.68.100 |
| Found | Yes |
| Hash | 67562bc13c7a8fad4e2479bbb880b60bbbefff3fdcd5b11b07113eca4e4f92bf |
| SimHash | 3784cb53eb6a |
Groups
*
| Rule | Path |
|---|---|
| Allow | /core/*.css$ |
| Allow | /core/*.css? |
| Allow | /core/*.js$ |
| Allow | /core/*.js? |
| Allow | /core/*.gif |
| Allow | /core/*.jpg |
| Allow | /core/*.jpeg |
| Allow | /core/*.png |
| Allow | /core/*.svg |
| Allow | /profiles/*.css$ |
| Allow | /profiles/*.css? |
| Allow | /profiles/*.js$ |
| Allow | /profiles/*.js? |
| Allow | /profiles/*.gif |
| Allow | /profiles/*.jpg |
| Allow | /profiles/*.jpeg |
| Allow | /profiles/*.png |
| Allow | /profiles/*.svg |
| Disallow | /*/?c-career-advice |
| Disallow | /*/apply/ |
| Disallow | /*/?c-category |
| Disallow | /*/?c-wf360-category |
| Disallow | /*/?c-tags |
| Disallow | /*/?c-press-category |
| Disallow | /*/mi- |
| Disallow | /*/km- |
| Disallow | /*/postcode- |
| Disallow | /*/sa- |
| Disallow | /*/qt- |
| Disallow | /*/d- |
| Disallow | /*/dc- |
| Disallow | /*search%3D |
| Disallow | /*search-app/demo/jobs/ |
| Disallow | /*jobs/mvp/ |
| Disallow | /jobs/*%2C*/ |
| Disallow | /*/?sortBy=* |
| Disallow | /*/sd- |
| Disallow | /*/sh- |
| Disallow | /*/sm- |
| Disallow | /*/?id=* |
| Disallow | /*/mpage- |
| Disallow | /taxonomy/term/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.randstadenterprise.com/sitemaps/sitemap.xml |
Comments