xml.tb.sogou.com
robots.txt
Robots Exclusion Standard data for xml.tb.sogou.com
Resource Scan
Scan Details
| Site Domain | xml.tb.sogou.com |
| Base Domain | sogou.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T18:57:28+00:00 |
| Next Scan | 2024-12-08T18:57:28+00:00 |
Last Scan
| Scanned | 2024-11-08T18:57:28+00:00 |
| URL | https://xml.tb.sogou.com/robots.txt |
| Domain IPs | 43.153.236.147 |
| Response IP | 43.153.236.147 |
| Found | Yes |
| Hash | cb4b423900fc55a01a74b8a44b288323774bbfdcd65c2df781aa699c7f29f6bf |
| SimHash | 1345b4374fb3 |
Groups
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
jikespider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
sosospider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
googlebot
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
msnbot
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /tx? |
| Disallow | /sie? |
| Disallow | /sgo? |
| Disallow | /lx? |
| Disallow | /ssc? |
| Disallow | /rotad? |
| Disallow | /websearch/websearch? |
| Disallow | /nba? |
| Disallow | /xml? |
| Disallow | /sr? |
| Disallow | /redirect? |
| Disallow | /link? |
| Disallow | /submit? |
| Disallow | /site? |
| Disallow | /sohu/sohu? |
| Disallow | /sohu/websearch? |
| Disallow | /sogou? |
| Disallow | /web? |
| Disallow | /sohu? |
| Disallow | /quan? |
| Disallow | /sgtest? |
| Disallow | /se? |
| Disallow | /gzh? |
| Disallow | /gzhwap? |
| Disallow | /weixin? |
| Disallow | /weixinwap? |
| Disallow | /websearch.do |
| Disallow | /websearch/websearch.do |
| Disallow | /zhishi/searchlist.jsp |
| Disallow | /express/sq.jsp |
| Disallow | /xueshu? |
| Disallow | /cidian? |
| Disallow | /dict? |
| Disallow | /scholar? |
| Disallow | /qq? |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 36 invalid lines.