Log In Sign Up

huya.com
robots.txt

Robots Exclusion Standard data for huya.com

Resource Scan

Scan Details

Site Domain huya.com
Base Domain huya.com
Scan Status Ok
Last Scan2024-05-20T15:31:29+00:00
Next Scan 2024-06-19T15:31:29+00:00

Last Scan

Scanned2024-05-20T15:31:29+00:00
URL https://huya.com/robots.txt
Redirect https://www.huya.com/robots.txt
Redirect Domain www.huya.com
Redirect Base huya.com
Domain IPs 101.35.220.127, 47.102.145.50, 8.134.122.50
Redirect IPs 163.181.160.224, 163.181.160.225, 163.181.160.226, 163.181.160.227, 163.181.160.228, 163.181.160.229, 163.181.160.230, 163.181.160.231, 2404:2280:1e0:0:3::3f1, 2404:2280:1e0:0:3::3f2
Response IP 163.181.160.228
Found Yes
Hash bb775ba923a337a7bcfd6ab62f090d40ce30025997168ba3c130646f13a16a0a
SimHash 0e765b142112

Groups

baiduspider

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

googlebot

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

sogou spider

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

sosospider

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

yodaobot

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

bingbot

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

slurp

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

msnbot

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

yisouspider

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

chinasospider

Rule Path
Disallow /member/
Disallow /api/
Disallow /web_api/
Disallow /udb_web/

*

Rule Path
Disallow /
Back to top

Warnings

  • 5 invalid lines.
Back to top