hku.baidu.com
robots.txt

Robots Exclusion Standard data for hku.baidu.com

Resource Scan

Scan Details

Site Domain hku.baidu.com
Base Domain baidu.com
Scan Status Ok
Last Scan2024-05-25T04:30:44+00:00
Next Scan 2024-06-08T04:30:44+00:00

Last Scan

Scanned2024-05-25T04:30:44+00:00
URL https://hku.baidu.com/robots.txt
Redirect https://haokan.baidu.com/robots.txt?cuid=
Redirect Domain haokan.baidu.com
Redirect Base baidu.com
Domain IPs 103.235.46.167
Redirect IPs 103.235.46.167
Response IP 45.113.192.110
Found Yes
Hash 22ccc8c56084a4c5359f54301a7ba3782d542256ed60492b926cb8b02822f2a3
SimHash 41065584634b

Groups

*

Rule Path
Disallow /haokan/ui-web/
Disallow /api/bidder/

baiduspider

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

googlebot

Rule Path
Allow /

youdaobot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sogou inst spider

Rule Path
Allow /

bingbot

Rule Path
Allow /

yisouspider

Rule Path
Allow /

applebot

Rule Path
Allow /

bytespider

Rule Path
Allow /

petalbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://haokan.baidu.com/haokan/ui-web/sitemap/index

Warnings

  • 2 invalid lines.