m.taobao.com
robots.txt
Robots Exclusion Standard data for m.taobao.com
Resource Scan
Scan Details
Site Domain | m.taobao.com |
Base Domain | taobao.com |
Scan Status | Ok |
Last Scan | 2025-02-25T02:03:24+00:00 |
Next Scan | 2025-03-27T02:03:24+00:00 |
Last Scan
Scanned | 2025-02-25T02:03:24+00:00 |
URL | https://m.taobao.com/robots.txt |
Redirect | https://h5.m.taobao.com/robots.txt |
Redirect Domain | h5.m.taobao.com |
Redirect Base | taobao.com |
Domain IPs | 163.181.81.191, 163.181.81.192, 2404:2280:1c1:0:3::3d7, 2404:2280:1c1:0:3::3d8 |
Redirect IPs | 163.181.81.191, 163.181.81.192, 2404:2280:1c1:0:3::3d7, 2404:2280:1c1:0:3::3d8 |
Response IP | 163.181.81.191 |
Found | Yes |
Hash | 55e0554cf44e21d7d4b3f85c3b9040e24fc83aadf234071bc0c615b5f71ba311 |
SimHash | ec5659452711 |
Groups
baiduspider
Rule | Path |
---|---|
Allow | /moshtml-cn |
Allow | /moshtml-zh |
Allow | /oversea |
Allow | /mershou |
Allow | /awp |
Disallow | / |
googlebot
Rule | Path |
---|---|
Allow | /moshtml-cn |
Allow | /moshtml-zh |
Allow | /oversea |
Allow | /mershou |
Allow | /awp |
Disallow | / |
bingbot
Rule | Path |
---|---|
Allow | /moshtml-cn |
Allow | /moshtml-zh |
Allow | /oversea |
Allow | /mershou |
Allow | /awp |
Disallow | / |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 6 invalid lines.