huobi.tj
robots.txt

Robots Exclusion Standard data for huobi.tj

Resource Scan

Scan Details

Site Domain huobi.tj
Base Domain huobi.tj
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-16T19:24:10+00:00
Next Scan 2024-12-15T19:24:10+00:00

Last Successful Scan

Scanned2022-11-26T22:46:46+00:00
URL https://www.huobi.tj/robots.txt
Response IP 104.18.26.37, 104.18.27.37
Found Yes
Hash 1987336e2cbf6aafc12f616465f6c4373c246ea30e489e57317e10fde9a7b4a4
SimHash c8d71d14b331

Groups

*

Rule Path
Allow /
Allow /*/topic/welcome-bonus/
Allow /*/topic/vip/
Allow /*/topic/defi-list/
Disallow /*?id=
Disallow /*/topic/
Disallow /*/user_center/
Disallow /*/user_/
Disallow /*/login_success/
Disallow /*/subaccount/
Disallow /*/transac/
Disallow /*/finance/
Disallow /*/withdraw_address/
Disallow /*/withdraw_result/
Disallow /*/withdraw_history/
Disallow /*/apikey/
Disallow /*/my_points/
Disallow /*/points_transfer/
Disallow /*/about/fee/
Disallow /*/finanrec/
Disallow /*/inmail/
Disallow /*/ht/
Disallow /*/user-center/
Disallow /*/coupon/
Disallow /*/score/
Disallow /*/grid-exchange/

Other Records

Field Value
sitemap https://www.huobi.com/sitemap.xml