91wan.com
robots.txt
Robots Exclusion Standard data for 91wan.com
Resource Scan
Scan Details
| Site Domain | 91wan.com |
| Base Domain | 91wan.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T02:59:57+00:00 |
| Next Scan | 2024-11-27T02:59:57+00:00 |
Last Scan
| Scanned | 2024-10-28T02:59:57+00:00 |
| URL | https://www.91wan.com/robots.txt |
| Domain IPs | 132.147.114.72 |
| Response IP | 138.113.199.19 |
| Found | Yes |
| Hash | 237460a469bd70569d7d70b92677c212d0bc838495a5f58a992d4713e0005415 |
| SimHash | 69475e140f00 |
Groups
baiduspider
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /info/ |
| Disallow | /info/index.html |
| Disallow | /*?* |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
| Disallow | /favicon.ico |
| Disallow | /user |
| Disallow | /image/ |
| Disallow | /inc/ |
| Disallow | /dede/ |
| Disallow | /editor/ |
| Disallow | /image/ |
| Disallow | /e/ |
| Disallow | /data/ |
| Disallow | /cn/ |
| Disallow | /base/ |
| Disallow | /apply/ |
| Disallow | /zxy/cklogin.php |
| Disallow | /data/admin/allowurl.txt |
| Disallow | /License.txt |
| Disallow | /themes/ |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sosospider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou web spider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou inst spider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou spider2
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou blog
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou news spider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
sogou orion spider
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?* |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*.bmp$ |
| Disallow | /*.js$ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 9 invalid lines.