pan.baidu.com
robots.txt
Robots Exclusion Standard data for pan.baidu.com
Resource Scan
Scan Details
| Site Domain | pan.baidu.com |
| Base Domain | baidu.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T21:41:35+00:00 |
| Next Scan | 2024-11-28T21:41:35+00:00 |
Last Scan
| Scanned | 2024-11-14T21:41:35+00:00 |
| URL | https://pan.baidu.com/robots.txt |
| Domain IPs | 124.237.208.37, 240c:4003:111:53:0:ff:b09a:146f, 36.110.192.103 |
| Response IP | 124.237.208.37 |
| Found | Yes |
| Hash | 27a61cfac1f6b8f8b066c89060079078b27f245f3bccd484a58140e680ff4122 |
| SimHash | db45dd91658b |
Groups
baiduspider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
baiduspider-video
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
baiduspider-news
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
googlebot
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
msnbot
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
jikespider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
sosospider
| Rule | Path |
|---|---|
| Disallow | /enterprise/ |
| Disallow | /share/link/ |
| Disallow | /wap/link/ |
| Disallow | /share/home/ |
| Disallow | /wap/share/home/ |
| Disallow | /s/1* |
| Disallow | /api/shorturlinfo |
| Disallow | /share/list |
| Disallow | /share/wxlist |
*
| Rule | Path |
|---|---|
| Disallow | / |