wapbaike.baidu.com
robots.txt

Robots Exclusion Standard data for wapbaike.baidu.com

Resource Scan

Scan Details

Site Domain wapbaike.baidu.com
Base Domain baidu.com
Scan Status Ok
Last Scan2024-08-30T00:50:54+00:00
Next Scan 2024-09-29T00:50:54+00:00

Last Scan

Scanned2024-08-30T00:50:54+00:00
URL https://wapbaike.baidu.com/robots.txt
Domain IPs 180.76.11.185, 240c:4003:111:adc7:0:ff:b0f2:3dbe
Response IP 180.76.11.185
Found Yes
Hash 74503a319ed04d94aa4b96d754f1a0370e4972bd7d12ad0867bd5b771a4dc81b
SimHash 8f65313a6f0b

Groups

baiduspider

Rule Path
Disallow /w?
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /item/
Disallow /pic/
Disallow /view/
Disallow /subview/
Disallow /l/
Disallow /search
Disallow /medicine
Disallow /wikicms/index/yidianarticle
Disallow /wikicms/index/yidianauthor

googlebot

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

bingbot

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

msnbot

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

baiduspider-image

Rule Path
Disallow /w?
Disallow /client/
Disallow /l/

youdaobot

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou web spider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou inst spider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou spider2

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou blog

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou news spider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sogou orion spider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

chinasospider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

sosospider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

yyspider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

yisouspider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

easouspider

Rule Path
Disallow /update
Disallow /history
Disallow /usercard
Disallow /usercenter
Disallow /client/
Disallow /divideload/
Disallow /edit/
Disallow /l/

*

Rule Path
Disallow /