h5.m.taobao.com
robots.txt

Robots Exclusion Standard data for h5.m.taobao.com

Resource Scan

Scan Details

Site Domain h5.m.taobao.com
Base Domain taobao.com
Scan Status Ok
Last Scan2025-02-16T14:37:40+00:00
Next Scan 2025-03-18T14:37:40+00:00

Last Scan

Scanned2025-02-16T14:37:40+00:00
URL https://h5.m.taobao.com/robots.txt
Domain IPs 163.181.81.191, 163.181.81.192, 2404:2280:1c1:0:3::3d7, 2404:2280:1c1:0:3::3d8
Response IP 163.181.81.192
Found Yes
Hash 55e0554cf44e21d7d4b3f85c3b9040e24fc83aadf234071bc0c615b5f71ba311
SimHash ec5659452711

Groups

baiduspider

Rule Path
Allow /moshtml-cn
Allow /moshtml-zh
Allow /oversea
Allow /mershou
Allow /awp
Disallow /

googlebot

Rule Path
Allow /moshtml-cn
Allow /moshtml-zh
Allow /oversea
Allow /mershou
Allow /awp
Disallow /

yisouspider

Rule Path
Allow /moshtml-cn
Allow /moshtml-zh
Allow /mershou
Allow /awp
Disallow /

bingbot

Rule Path
Allow /moshtml-cn
Allow /moshtml-zh
Allow /oversea
Allow /mershou
Allow /awp
Disallow /

sogouspider

Rule Path
Allow /moshtml-cn
Allow /moshtml-zh
Allow /mershou
Allow /awp
Disallow /

yahoo! slurp

Rule Path
Allow /oversea
Allow /mershou
Allow /awp
Disallow /

*

Rule Path
Disallow /

Warnings

  • 6 invalid lines.