baike.soso.com
robots.txt

Robots Exclusion Standard data for baike.soso.com

Resource Scan

Scan Details

Site Domain baike.soso.com
Base Domain soso.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T14:06:07+00:00
Next Scan 2024-11-12T14:06:07+00:00

Last Successful Scan

Scanned2023-12-18T13:00:30+00:00
URL https://baike.soso.com/robots.txt
Redirect https://baike.sogou.com/robots.txt
Redirect Domain baike.sogou.com
Redirect Base sogou.com
Domain IPs 123.150.76.224
Redirect IPs 129.226.103.233, 129.226.107.79
Response IP 129.226.103.233
Found Yes
Hash 91cd452927f11e9aacfb4c37326fbf96d1bf7e1b002c445dfb8d2fda0ea14748
SimHash ce6ee9366b2b

Groups

sosospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

googlebot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-video

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-news

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

msnbot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-image

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

youdaobot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou web spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou inst spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou spider2

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou blog

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou news spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou orion spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

jikespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

yisouspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

pangusospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

bytespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

*

Rule Path
Disallow /