tb1.bdstatic.com
robots.txt

Robots Exclusion Standard data for tb1.bdstatic.com

Resource Scan

Scan Details

Site Domain tb1.bdstatic.com
Base Domain bdstatic.com
Scan Status Ok
Last Scan2024-11-04T21:56:55+00:00
Next Scan 2024-11-18T21:56:55+00:00

Last Scan

Scanned2024-11-04T21:56:55+00:00
URL https://tb1.bdstatic.com/robots.txt
Domain IPs 101.72.203.48, 110.53.110.48, 119.188.176.48, 157.148.65.48, 211.95.34.48, 211.97.83.48, 218.98.32.48, 221.204.49.48, 2408:862e:ff:fe0b::da3c:ac30, 2408:8719:64:17::77bc:b030, 2408:871a:5100:200::6548:cb30, 2408:871a:b800:11::7916:ef30, 2408:8744:600:1004::7084:d030, 2408:8752:100:b::2a30:8f30, 2408:8756:aff:400::3afe:9630, 2408:8756:c9f:1000::9d94:4130, 2408:875c:0:100::d361:5330, 2408:8766:1:3::65cf:fb30, 27.221.38.48, 61.163.9.48
Response IP 101.72.199.48
Found Yes
Hash 3c76c6178868366a79154241be77938680506919294897b34eb1d7afafbd7d72
SimHash d745dd37670b

Groups

baiduspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-video

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-news

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

googlebot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

baiduspider-image

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

youdaobot

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou web spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou inst spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou spider2

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou blog

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou news spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sogou orion spider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

sosospider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

yyspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

chinasospider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

yisouspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

easouspider

Rule Path
Disallow /club/
Disallow /f/shipin
Disallow /f/search

toutiaospider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /