thinkchina.sg
robots.txt
Robots Exclusion Standard data for thinkchina.sg
Resource Scan
Scan Details
Site Domain | thinkchina.sg |
Base Domain | thinkchina.sg |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-11T05:19:43+00:00 |
Next Scan | 2024-12-10T05:19:43+00:00 |
Last Successful Scan
Scanned | 2024-05-14T14:31:29+00:00 |
URL | https://thinkchina.sg/robots.txt |
Redirect | https://www.thinkchina.sg/robots.txt |
Redirect Domain | www.thinkchina.sg |
Redirect Base | thinkchina.sg |
Domain IPs | 54.240.162.30, 54.240.162.47, 54.240.162.58, 54.240.162.68 |
Redirect IPs | 18.172.52.106, 18.172.52.110, 18.172.52.12, 18.172.52.16 |
Response IP | 108.157.254.22 |
Found | Yes |
Hash | 1eadd875b5c54a8f7b27e4cfe347a3b2aac5c6b598c718213763f763e9dec7a0 |
SimHash | 6050d9040333 |
Groups
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.thinkchina.sg/_plat/api/sitemap |
Comments