baike.sogou.com
robots.txt

Robots Exclusion Standard data for baike.sogou.com

Resource Scan

Scan Details

Site Domain baike.sogou.com
Base Domain sogou.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-03T18:03:10+00:00
Next Scan 2025-01-02T18:03:10+00:00

Last Successful Scan

Scanned2022-11-21T00:21:58+00:00
URL https://baike.sogou.com/robots.txt
Response IP 203.205.235.65
Found Yes
Hash 91cd452927f11e9aacfb4c37326fbf96d1bf7e1b002c445dfb8d2fda0ea14748
SimHash ce6ee9366b2b

Groups

sosospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

googlebot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-video

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-news

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

msnbot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-image

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

youdaobot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou web spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou inst spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou spider2

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou blog

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou news spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou orion spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

jikespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

yisouspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

pangusospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

bytespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

*

Rule Path
Disallow /