randstad.com.hk
robots.txt
Robots Exclusion Standard data for randstad.com.hk
Resource Scan
Scan Details
| Site Domain | randstad.com.hk |
| Base Domain | randstad.com.hk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-18T04:50:25+00:00 |
| Next Scan | 2024-11-19T04:50:25+00:00 |
Last Successful Scan
| Scanned | 2024-10-19T04:50:21+00:00 |
| URL | https://randstad.com.hk/robots.txt |
| Redirect | https://www.randstad.com.hk/robots.txt |
| Redirect Domain | www.randstad.com.hk |
| Redirect Base | randstad.com.hk |
| Domain IPs | 13.33.88.111, 13.33.88.112, 13.33.88.113, 13.33.88.33 |
| Redirect IPs | 13.35.185.23, 13.35.185.50, 13.35.185.58, 13.35.185.62, 2600:9000:2079:1c00:9:771e:3bc0:93a1, 2600:9000:2079:4200:9:771e:3bc0:93a1, 2600:9000:2079:5200:9:771e:3bc0:93a1, 2600:9000:2079:6000:9:771e:3bc0:93a1, 2600:9000:2079:6600:9:771e:3bc0:93a1, 2600:9000:2079:7a00:9:771e:3bc0:93a1, 2600:9000:2079:8200:9:771e:3bc0:93a1, 2600:9000:2079:b200:9:771e:3bc0:93a1 |
| Response IP | 13.33.88.112 |
| Found | Yes |
| Hash | 358d5e623e5ed0676b9174f1a09b2c6d06ebba1a84d708acea06dfe97e5f2338 |
| SimHash | 7515d212eaf0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*/mi- |
| Disallow | /*/km- |
| Disallow | /*/postcode- |
| Disallow | /*/sa- |
| Disallow | /*/qt- |
| Disallow | /*search%3D |
| Disallow | /*search-app/demo/jobs/ |
| Disallow | /*jobs/mvp/ |
| Disallow | /jobs/*%2C*/ |
| Disallow | /*/sd- |
| Disallow | /*/sh- |
| Disallow | /*/sm- |
| Disallow | /*/?id=* |
| Disallow | /*/mpage- |
| Disallow | /*/apply/ |
| Disallow | /*/?c-career-advice |
| Disallow | /*/?c-category |
| Disallow | /*/?c-wf360-category |
| Disallow | /*/?c-tags |
| Disallow | /*/?c-press-category |
| Disallow | /taxonomy/term/ |
| Disallow | /*/profile- |
| Disallow | /node/ |
| Disallow | /*/node/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.randstad.com.hk/sitemaps/sitemap.xml |
Comments