bk.n.shifen.com
robots.txt
Robots Exclusion Standard data for bk.n.shifen.com
Resource Scan
Scan Details
| Site Domain | bk.n.shifen.com |
| Base Domain | shifen.com |
| Scan Status | Ok |
| Last Scan | 2024-08-27T19:30:35+00:00 |
| Next Scan | 2024-09-26T19:30:35+00:00 |
Last Scan
| Scanned | 2024-08-27T19:30:35+00:00 |
| URL | http://bk.n.shifen.com/robots.txt |
| Redirect | https://baike.baidu.com/robots.txt |
| Redirect Domain | baike.baidu.com |
| Redirect Base | baidu.com |
| Domain IPs | 180.76.11.185, 240c:4003:111:adc7:0:ff:b0f2:3dbe |
| Redirect IPs | 180.76.11.185, 240c:4003:111:adc7:0:ff:b0f2:3dbe |
| Response IP | 180.76.11.185 |
| Found | Yes |
| Hash | c5e4d5e2fc342a33c6d7bb0f4f15c699a7d614a9c85bf46ed332567ce792bdbe |
| SimHash | 2455b13a673b |
Groups
baiduspider
| Rule | Path |
|---|---|
| Disallow | /w? |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
| Disallow | /search |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /w? |
| Disallow | /client/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
chinasospider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
sosospider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
yyspider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
easouspider
| Rule | Path |
|---|---|
| Disallow | /update |
| Disallow | /history |
| Disallow | /usercard |
| Disallow | /usercenter |
| Disallow | /client/ |
| Disallow | /divideload/ |
| Disallow | /edit/ |
| Disallow | /l/ |
| Disallow | /redirect/ |
| Disallow | /reference/ |
*
| Rule | Path |
|---|---|
| Disallow | / |