bdstatic.com
robots.txt
Robots Exclusion Standard data for bdstatic.com
Resource Scan
Scan Details
Site Domain | bdstatic.com |
Base Domain | bdstatic.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-20T09:06:11+00:00 |
Next Scan | 2024-09-27T09:06:11+00:00 |
Last Successful Scan
Scanned | 2024-08-20T01:43:16+00:00 |
URL | http://bdstatic.com/robots.txt |
Domain IPs | 220.181.38.148, 220.181.38.251, 39.156.66.10 |
Response IP | 39.156.66.10 |
Found | Yes |
Hash | 2d8ec3a400ae01b7af4828521ee6049bf62ce639dfac2bc3debf132ca7b3d2af |
SimHash | 5a65dd2a2901 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
msnbot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
baiduspider-image
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
youdaobot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou web spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou inst spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou spider2
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou blog
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou news spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sogou orion spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
jikespider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
sosospider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
pangusospider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
yisouspider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
easouspider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
*
Rule | Path |
---|---|
Disallow | / |