sohucs.com
robots.txt
Robots Exclusion Standard data for sohucs.com
Resource Scan
Scan Details
Site Domain | sohucs.com |
Base Domain | sohucs.com |
Scan Status | Ok |
Last Scan | 2024-10-10T17:08:24+00:00 |
Next Scan | 2024-10-17T17:08:24+00:00 |
Last Scan
Scanned | 2024-10-10T17:08:24+00:00 |
URL | http://sohucs.com/robots.txt |
Redirect | https://www.sohu.com/robots.txt |
Redirect Domain | www.sohu.com |
Redirect Base | sohu.com |
Domain IPs | 61.135.164.51 |
Redirect IPs | 43.132.81.61, 43.159.70.125, 43.159.71.118 |
Response IP | 43.159.71.118 |
Found | Yes |
Hash | 86e6caf81c87d40697c88cb7563b774ae0644fa4c056d666838242cf89555027 |
SimHash | 2b4755724a8a |
Groups
baiduspider
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
yisouspider
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
bytespider
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
Allow | /integration-api/*?* |
Allow | /public-api/*?* |
msnbot
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
googlebot
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
toutiaospider
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
Allow | /integration-api/*?* |
Allow | /public-api/*?* |
bingbot
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
dingtalkbot
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
pinterestbot
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
sogou web spider
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
mediapartners-google
Rule | Path |
---|---|
Disallow | /*?* |
Allow | /a/*?* |
Allow | /abroad_a/*?* |
Allow | /picture/*?* |
Allow | /*_a%28/qihoo_a%29/*?* |
Allow | /collection/*?* |
Allow | /ab_a/*?* |
Allow | /classic*?* |
Allow | /?*$ |
Allow | /new*?* |
Allow | /business*?* |
Allow | /it*?* |
Allow | /fashion*?* |
Allow | /leaening*?* |
Allow | /health*?* |
Allow | /yule*?* |
Allow | /mt*?* |
Allow | /travel*?* |
Allow | /baobao*?* |
Allow | /chihe*?* |
Allow | /cul*?* |
Allow | /history*?* |
Allow | /gov*?* |
Allow | /gongyi*?* |
Allow | /police*?* |
Allow | /mil*?* |
Allow | /acg*?* |
Allow | /astro*?* |
Allow | /game*?* |
Allow | /pets*?* |
Allow | /sports*?* |
Allow | /subject/*?* |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 33 invalid lines.