malatown.com.cn
robots.txt

Robots Exclusion Standard data for malatown.com.cn

Resource Scan

Scan Details

Site Domain malatown.com.cn
Base Domain malatown.com.cn
Scan Status Ok
Last Scan2024-10-01T14:45:39+00:00
Next Scan 2024-10-31T14:45:39+00:00

Last Scan

Scanned2024-10-01T14:45:39+00:00
URL https://www.malatown.com.cn/robots.txt
Domain IPs 113.219.142.35
Response IP 113.219.142.35
Found Yes
Hash 9ff8dc122fe10b48d54407f17f1bd994fce62e144c9db6e8268cc26308a68bd2
SimHash f2cc1d42d083

Groups

googlebot

Rule Path
Disallow /asp
Disallow /*searc
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

baiduspider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*oo*
Disallow /photo
Disallow /mob
Disallow /m/

baiduspider-image

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

youdaobot

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

sogou web spider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

sogou spider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

sosospider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

yisouspider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

baiduspider-render

Rule Path
Disallow /asp/
Disallow /mob
Disallow /m/
Disallow /_cookies_*.asp
Disallow /js/foot_*m3.js

bytespider

Rule Path
Disallow /asp/
Disallow /*search
Disallow /*pxfs*
Disallow /*ooo*
Disallow /photo
Disallow /mob
Disallow /m/

*

Rule Path
Disallow /

Warnings

  • 9 invalid lines.