wapbaike.baidu.com
robots.txt
Robots Exclusion Standard data for wapbaike.baidu.com
Resource Scan
Scan Details
Site Domain | wapbaike.baidu.com |
Base Domain | baidu.com |
Scan Status | Ok |
Last Scan | 2024-08-30T00:50:54+00:00 |
Next Scan | 2024-09-29T00:50:54+00:00 |
Last Scan
Scanned | 2024-08-30T00:50:54+00:00 |
URL | https://wapbaike.baidu.com/robots.txt |
Domain IPs | 180.76.11.185, 240c:4003:111:adc7:0:ff:b0f2:3dbe |
Response IP | 180.76.11.185 |
Found | Yes |
Hash | 74503a319ed04d94aa4b96d754f1a0370e4972bd7d12ad0867bd5b771a4dc81b |
SimHash | 8f65313a6f0b |
Groups
baiduspider
Rule | Path |
---|---|
Disallow | /w? |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /item/ |
Disallow | /pic/ |
Disallow | /view/ |
Disallow | /subview/ |
Disallow | /l/ |
Disallow | /search |
Disallow | /medicine |
Disallow | /wikicms/index/yidianarticle |
Disallow | /wikicms/index/yidianauthor |
googlebot
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
bingbot
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
msnbot
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
youdaobot
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou web spider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou inst spider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou spider2
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou blog
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou news spider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sogou orion spider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
chinasospider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
sosospider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
yyspider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
yisouspider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
easouspider
Rule | Path |
---|---|
Disallow | /update |
Disallow | /history |
Disallow | /usercard |
Disallow | /usercenter |
Disallow | /client/ |
Disallow | /divideload/ |
Disallow | /edit/ |
Disallow | /l/ |
*
Rule | Path |
---|---|
Disallow | / |