wenwen.sogou.com
robots.txt

Robots Exclusion Standard data for wenwen.sogou.com

Resource Scan

Scan Details

Site Domain wenwen.sogou.com
Base Domain sogou.com
Scan Status Ok
Last Scan2024-11-09T23:31:03+00:00
Next Scan 2024-12-09T23:31:03+00:00

Last Scan

Scanned2024-11-09T23:31:03+00:00
URL https://wenwen.sogou.com/robots.txt
Domain IPs 101.32.212.153
Response IP 101.32.212.153
Found Yes
Hash 21ab6a43b8f8bb630776d589a2d0f62301637527700235beeb14a4209334c1a3
SimHash c654d516630b

Groups

sosospider

Rule Path
Disallow /user/center
Disallow /cate/mall

googlebot

Rule Path
Disallow /user/center
Disallow /cate/mall

baiduspider

Rule Path
Disallow /user/center
Disallow /cate/mall

baiduspider-video

Rule Path
Disallow /user/center
Disallow /cate/mall

baiduspider-news

Rule Path
Disallow /user/center
Disallow /cate/mall

msnbot

Rule Path
Disallow /user/center
Disallow /cate/mall

baiduspider-image

Rule Path
Disallow /user/center
Disallow /cate/mall

youdaobot

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou web spider

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou inst spider

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou spider2

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou blog

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou news spider

Rule Path
Disallow /user/center
Disallow /cate/mall

sogou orion spider

Rule Path
Disallow /user/center
Disallow /cate/mall

jikespider

Rule Path
Disallow /user/center
Disallow /cate/mall

yisouspider

Rule Path
Disallow /user/center
Disallow /cate/mall

pangusospider

Rule Path
Disallow /user/center
Disallow /cate/mall

bytespider

Rule Path
Disallow /user/center
Disallow /cate/mall

*

Rule Path
Disallow /