wenda.so.com
robots.txt
Robots Exclusion Standard data for wenda.so.com
Resource Scan
Scan Details
Site Domain | wenda.so.com |
Base Domain | so.com |
Scan Status | Ok |
Last Scan | 2024-06-02T22:10:28+00:00 |
Next Scan | 2024-07-02T22:10:28+00:00 |
Last Scan
Scanned | 2024-06-02T22:10:28+00:00 |
URL | https://wenda.so.com/robots.txt |
Domain IPs | 104.192.110.71 |
Response IP | 104.192.110.71 |
Found | Yes |
Hash | b5ebcb061bf61dd852e2d1f70bc9539e1307d857110800bc9564ae325f40b5be |
SimHash | 2d5653166ad3 |
Groups
baiduspider
baiduspider-news
baiduspider-image
Rule | Path |
---|---|
Disallow | /search/? |
Disallow | /home/ask? |
Disallow | /u/ |
Disallow | /user/ |
Disallow | /userMgr/ |
Disallow | /userMgrApply/ |
Disallow | /UserMgrAudit/ |
sogou web spider
sogou inst spider
Rule | Path |
---|---|
Disallow | /search/? |
Disallow | /home/ask? |
Disallow | /u/ |
Disallow | /user/ |
Disallow | /userMgr/ |
Disallow | /userMgrApply/ |
Disallow | /UserMgrAudit/ |
sosospider
Rule | Path |
---|---|
Disallow | /search/? |
Disallow | /home/ask? |
Disallow | /u/ |
Disallow | /user/ |
Disallow | /userMgr/ |
Disallow | /userMgrApply/ |
Disallow | /UserMgrAudit/ |
googlebot
Rule | Path |
---|---|
Disallow | /search/? |
Disallow | /home/ask? |
Disallow | /u/ |
Disallow | /user/ |
Disallow | /userMgr/ |
Disallow | /userMgrApply/ |
Disallow | /UserMgrAudit/ |
bingbot
Rule | Path |
---|---|
Disallow | /search/? |
Disallow | /home/ask? |
Disallow | /u/ |
Disallow | /user/ |
Disallow | /userMgr/ |
Disallow | /userMgrApply/ |
Disallow | /UserMgrAudit/ |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 8 invalid lines.