baike.sogou.com
robots.txt
Robots Exclusion Standard data for baike.sogou.com
Resource Scan
Scan Details
Site Domain | baike.sogou.com |
Base Domain | sogou.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-03T18:03:10+00:00 |
Next Scan | 2025-01-02T18:03:10+00:00 |
Last Successful Scan
Scanned | 2022-11-21T00:21:58+00:00 |
URL | https://baike.sogou.com/robots.txt |
Response IP | 203.205.235.65 |
Found | Yes |
Hash | 91cd452927f11e9aacfb4c37326fbf96d1bf7e1b002c445dfb8d2fda0ea14748 |
SimHash | ce6ee9366b2b |
Groups
sosospider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
googlebot
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
baiduspider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
baiduspider-video
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
baiduspider-news
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
msnbot
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
baiduspider-image
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
youdaobot
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou web spider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou inst spider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou spider2
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou blog
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou news spider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
sogou orion spider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
jikespider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
yisouspider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
pangusospider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
bytespider
Rule | Path |
---|---|
Disallow | /usercenter/* |
Disallow | /mall/* |
Disallow | /welfare |
Disallow | /userAssignmentInde |
Disallow | /task/activity/task |
Disallow | /ShowHistory |
Disallow | /historylemma |
Disallow | /VersionCompare |
Disallow | /kexue/* |
*
Rule | Path |
---|---|
Disallow | / |