58.com
robots.txt
Robots Exclusion Standard data for 58.com
Resource Scan
Scan Details
| Site Domain | 58.com |
| Base Domain | 58.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T19:44:58+00:00 |
| Next Scan | 2024-07-26T19:44:58+00:00 |
Last Scan
| Scanned | 2024-06-26T19:44:58+00:00 |
| URL | https://58.com/robots.txt |
| Domain IPs | 2402:4e00:4020:f::1:4, 42.187.161.231 |
| Response IP | 42.187.161.231 |
| Found | Yes |
| Hash | c70ce393b622c845acd1991dbaad93ef59caf7a8f78df8206972451dc52c7460 |
| SimHash | e91092924eb0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /shoujidaquan/* |
| Disallow | /*?* |
| Disallow | /sou/*Q* |
| Disallow | link.58.com |
| Disallow | link.58.com/* |
| Disallow | /wenda/*/all/ |
| Disallow | /wenda/*/list-*/ |
| Disallow | /wenda/*/tg-*/ |
| Disallow | /wenda/mr*.shtml |
| Disallow | /wenda/xq*.shtml |
| Disallow | /wenda/dr*.shtml |
| Disallow | /a/ershouche/* |
| Disallow | /a/dedecms/* |
| Disallow | cheapi.58.com* |
| Disallow | cheapi.58.com/* |