huobi.pe
robots.txt
Robots Exclusion Standard data for huobi.pe
Resource Scan
Scan Details
Site Domain | huobi.pe |
Base Domain | huobi.pe |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't establish SSL connection. |
Last Scan | 2024-09-27T04:35:54+00:00 |
Next Scan | 2024-09-28T04:35:54+00:00 |
Last Successful Scan
Scanned | 2024-09-20T04:31:23+00:00 |
URL | http://www.huobi.pe/robots.txt |
Redirect | https://www.htx.com/robots.txt |
Redirect Domain | www.htx.com |
Redirect Base | htx.com |
Domain IPs | 54.238.44.239 |
Redirect IPs | 104.18.40.138, 172.64.147.118, 2606:4700:4400::6812:288a, 2606:4700:4400::ac40:9376 |
Response IP | 104.18.40.138 |
Found | Yes |
Hash | 363abaede8056843c54607f5272e61dcacba8237c707249ae240d4c2ccb6a91f |
SimHash | 43145d614630 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */finance/account |
Disallow | */transac |
Disallow | */futures/contract/assets |
Disallow | */user-center/security |
Disallow | */fiat-crypto/user-center/orders |
Disallow | */futures/linear_swap/current_orders |
Disallow | */financial/earn/order |
Other Records
Field | Value |
---|---|
sitemap | https://www.htx.com/trade/sitemap.xml |
sitemap | https://www.htx.com/news/sitemap.xml |
sitemap | https://www.htx.com/activitys/sitemap.xml |
sitemap | https://www.htx.com/earn/sitemap.xml |
sitemap | https://www.htx.com/contract/sitemap.xml |
sitemap | https://www.htx.com/other/sitemap.xml |
sitemap | https://www.htx.com/otc/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.