api.baike.sogou.com
robots.txt

Robots Exclusion Standard data for api.baike.sogou.com

Resource Scan

Scan Details

Site Domain api.baike.sogou.com
Base Domain sogou.com
Scan Status Ok
Last Scan2024-05-25T03:42:06+00:00
Next Scan 2024-06-24T03:42:06+00:00

Last Scan

Scanned2024-05-25T03:42:06+00:00
URL https://api.baike.sogou.com/robots.txt
Domain IPs 43.129.255.211, 43.129.255.239
Response IP 43.129.255.211
Found Yes
Hash 1a535a3bb89fa5efd68e37219bcfebf1aaae61ce6ddf2f1d6930975a96944d5e
SimHash ce6ee9366b2b

Groups

sosospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

googlebot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-video

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-news

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

msnbot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

baiduspider-image

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

youdaobot

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou web spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou inst spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou spider2

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou blog

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou news spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

sogou orion spider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

jikespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

yisouspider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

pangusospider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

bytespider

Rule Path
Disallow /usercenter/*
Disallow /mall/*
Disallow /welfare
Disallow /userAssignmentInde
Disallow /task/activity/task
Disallow /ShowHistory
Disallow /historylemma
Disallow /VersionCompare
Disallow /kexue/*

*

Rule Path
Disallow /