Log In Sign Up

sohu.com
robots.txt

Robots Exclusion Standard data for sohu.com

Resource Scan

Scan Details

Site Domain sohu.com
Base Domain sohu.com
Scan Status Ok
Last Scan2024-04-27T23:00:56+00:00
Next Scan 2024-05-04T23:00:56+00:00

Last Scan

Scanned2024-04-27T23:00:56+00:00
URL https://sohu.com/robots.txt
Redirect https://www.sohu.com/robots.txt
Redirect Domain www.sohu.com
Redirect Base sohu.com
Domain IPs 61.135.164.50
Redirect IPs 101.33.27.25, 43.132.81.61
Response IP 43.132.81.61
Found Yes
Hash 86e6caf81c87d40697c88cb7563b774ae0644fa4c056d666838242cf89555027
SimHash 2b4755724a8a

Groups

baiduspider

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

yisouspider

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

bytespider

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*
Allow /integration-api/*?*
Allow /public-api/*?*

msnbot

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

googlebot

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

toutiaospider

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*
Allow /integration-api/*?*
Allow /public-api/*?*

bingbot

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

dingtalkbot

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

pinterestbot

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

sogou web spider

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

mediapartners-google

Rule Path
Disallow /*?*
Allow /a/*?*
Allow /abroad_a/*?*
Allow /picture/*?*
Allow /*_a%28/qihoo_a%29/*?*
Allow /collection/*?*
Allow /ab_a/*?*
Allow /classic*?*
Allow /?*$
Allow /new*?*
Allow /business*?*
Allow /it*?*
Allow /fashion*?*
Allow /leaening*?*
Allow /health*?*
Allow /yule*?*
Allow /mt*?*
Allow /travel*?*
Allow /baobao*?*
Allow /chihe*?*
Allow /cul*?*
Allow /history*?*
Allow /gov*?*
Allow /gongyi*?*
Allow /police*?*
Allow /mil*?*
Allow /acg*?*
Allow /astro*?*
Allow /game*?*
Allow /pets*?*
Allow /sports*?*
Allow /subject/*?*

*

Rule Path
Disallow /
Back to top

Warnings

  • 33 invalid lines.
Back to top