m.mafengwo.cn
robots.txt

Robots Exclusion Standard data for m.mafengwo.cn

Resource Scan

Scan Details

Site Domain m.mafengwo.cn
Base Domain mafengwo.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-09T07:17:09+00:00
Next Scan 2024-11-23T07:17:09+00:00

Last Successful Scan

Scanned2024-07-26T04:21:22+00:00
URL https://m.mafengwo.cn/robots.txt
Domain IPs 43.132.81.61, 43.159.70.125, 43.159.71.118
Response IP 43.132.81.61
Found Yes
Hash 7534a27bd1916fc8dd3b70198547f4c4c21410ca76e30613f590e794b7479931
SimHash 6c5052037431

Groups

baiduspider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

bytespider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

sosospider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

sogou wap spider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

yodaobot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

bingbot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

slurp

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

teoma

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

ia_archiver

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

twiceler

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

msnbot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

scrubby

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

robozilla

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

gigabot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-image

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-mobile

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

yahoo-mmcrawler

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

yahoo-blogs/v3.9

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

psbot

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-news

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-image

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-video

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

googlebot-mobile

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

mediapartners-google

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

mediapartners(googlebot)

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

adsbot-google

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

haosouspider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

iaskspider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

yisouspider

Rule Path
Disallow /coo
Disallow /gro
Disallow /use

*

Rule Path
Disallow /po
Disallow /mom

*

Rule Path
Disallow *?mfw_chid=*

Warnings

  • 12 invalid lines.