stjobs.sg
robots.txt
Robots Exclusion Standard data for stjobs.sg
Resource Scan
Scan Details
Site Domain | stjobs.sg |
Base Domain | stjobs.sg |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-26T22:43:41+00:00 |
Next Scan | 2024-12-25T22:43:41+00:00 |
Last Successful Scan
Scanned | 2024-05-07T22:42:16+00:00 |
URL | https://stjobs.sg/robots.txt |
Redirect | https://www.stjobs.sg/robots.txt |
Redirect Domain | www.stjobs.sg |
Redirect Base | stjobs.sg |
Domain IPs | 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90 |
Redirect IPs | 152.195.56.190 |
Response IP | 152.195.56.190 |
Found | Yes |
Hash | 6e08ed6ae91c92e83a841755e0b537e99868d06041939d0a7efd0a00b64d6b47 |
SimHash | 7040f90e4337 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /template/ |
Disallow | /mob/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.stjobs.sg/sitemaps/sitemap-index.xml |
Comments