baidustatic.com
robots.txt
Robots Exclusion Standard data for baidustatic.com
Resource Scan
Scan Details
| Site Domain | baidustatic.com |
| Base Domain | baidustatic.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T19:21:59+00:00 |
| Next Scan | 2024-09-22T19:21:59+00:00 |
Last Scan
| Scanned | 2024-09-21T19:21:59+00:00 |
| URL | http://baidustatic.com/robots.txt |
| Domain IPs | 220.181.38.148, 220.181.38.251, 39.156.66.10 |
| Response IP | 39.156.66.10 |
| Found | Yes |
| Hash | 2d8ec3a400ae01b7af4828521ee6049bf62ce639dfac2bc3debf132ca7b3d2af |
| SimHash | 5a65dd2a2901 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
msnbot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
jikespider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sosospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
pangusospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
yisouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
easouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
*
| Rule | Path |
|---|---|
| Disallow | / |