jingyan.baidu.com
robots.txt

Robots Exclusion Standard data for jingyan.baidu.com

Resource Scan

Scan Details

Site Domain jingyan.baidu.com
Base Domain baidu.com
Scan Status Ok
Last Scan2024-09-20T18:53:28+00:00
Next Scan 2024-10-20T18:53:28+00:00

Last Scan

Scanned2024-09-20T18:53:28+00:00
URL https://jingyan.baidu.com/robots.txt
Domain IPs 110.242.69.184, 111.206.209.109, 111.206.209.111
Response IP 111.206.209.109
Found Yes
Hash ae108bc0757431d5a179eababeb5913daa028e8c309744ee3854cf8fd19a4bf1
SimHash cd44ddbb6982

Groups

baiduspider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

baiduspider-image

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

baiduspider-video

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

baiduspider-news

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

googlebot

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

msnbot

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

youdaobot

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou web spider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou inst spider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou spider2

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou blog

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou news spider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sogou orion spider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/

chinasospider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

sosospider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

yisouspider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

easouspider

Rule Path
Disallow /magazine/
Disallow /user/
Disallow /tag/
Disallow /list/
Disallow /search/
Disallow /album/

*

Rule Path
Disallow /