tb2.bdstatic.com
robots.txt

Robots Exclusion Standard data for tb2.bdstatic.com

Resource Scan

Scan Details

Site Domain tb2.bdstatic.com
Base Domain bdstatic.com
Scan Status Ok
Last Scan2024-11-01T16:24:36+00:00
Next Scan 2024-11-15T16:24:36+00:00

Last Scan

Scanned2024-11-01T16:24:36+00:00
URL https://tb2.bdstatic.com/robots.txt
Domain IPs 101.72.199.48, 150.138.157.48, 218.60.172.48, 218.60.173.48, 221.204.49.48, 221.204.61.48, 2408:8678:be00:7::2a3f:3230, 2408:870c:1040:1::d35f:2230, 2408:8719:64:17::77bc:b030, 2408:8719:64:9a::275b:b630, 2408:871a:9001:100::3c06:c430, 2408:871a:b800:11::7916:ef30, 2408:8722:5800:2::3da3:3330, 2408:8726:1001:100::ddcc:3130, 2408:872b:d80:2::7472:6230, 2408:873c:b010:1010::da62:2030, 27.221.38.48, 42.59.17.48, 60.221.18.48, 61.163.9.48
Response IP 211.97.83.48
Found Yes
Hash 3c76c6178868366a79154241be77938680506919294897b34eb1d7afafbd7d72
SimHash d745dd37670b

Groups

baiduspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-video

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-news

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

googlebot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-image

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

youdaobot

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou web spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou inst spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou spider2

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou blog

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou news spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou orion spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sosospider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

yyspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

chinasospider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

yisouspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

easouspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

toutiaospider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /