businesstimes.com.hk
robots.txt
Robots Exclusion Standard data for businesstimes.com.hk
Resource Scan
Scan Details
| Site Domain | businesstimes.com.hk |
| Base Domain | businesstimes.com.hk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-22T15:31:53+00:00 |
| Next Scan | 2025-01-20T15:31:53+00:00 |
Last Successful Scan
| Scanned | 2024-06-25T15:24:18+00:00 |
| URL | https://businesstimes.com.hk/robots.txt |
| Redirect | https://www.businesstimes.com.hk:443/robots.txt |
| Redirect Domain | www.businesstimes.com.hk |
| Redirect Base | businesstimes.com.hk |
| Domain IPs | 104.21.74.52, 172.67.155.65, 2606:4700:3030::6815:4a34, 2606:4700:3036::ac43:9b41 |
| Redirect IPs | 104.21.74.52, 172.67.155.65, 2606:4700:3030::6815:4a34, 2606:4700:3036::ac43:9b41 |
| Response IP | 172.67.155.65 |
| Found | Yes |
| Hash | a48dd32fb92dfef2c317309823e67e8fc4d72275497c0acc684d4fb2def22833 |
| SimHash | 5114865dc5b3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /articles/ |
| Allow | /news/ |
| Allow | /column/ |
| Allow | /finance/ |
| Allow | /interview/ |
| Allow | /property/ |
| Allow | /tags/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.businesstimes.com.hk/article-sitemap.xml |
| sitemap | https://www.businesstimes.com.hk/page-sitemap.xml |
| sitemap | https://www.businesstimes.com.hk/sitemap.xml |