Log In Sign Up

z.mafengwo.cn
robots.txt

Robots Exclusion Standard data for z.mafengwo.cn

Resource Scan

Scan Details

Site Domain z.mafengwo.cn
Base Domain mafengwo.cn
Scan Status Ok
Last Scan2024-05-22T17:33:26+00:00
Next Scan 2024-06-21T17:33:26+00:00

Last Scan

Scanned2024-05-22T17:33:26+00:00
URL https://z.mafengwo.cn/robots.txt
Domain IPs 43.132.81.61, 43.159.70.125, 43.159.71.118
Response IP 43.159.71.118
Found Yes
Hash 44a78eed8b46e9c7eef644202d541c357cb1fd18c6b16e26b16e2c866d0958ee
SimHash 4c1550424614

Groups

baiduspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

sosospider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

sogou spider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yodaobot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

bingbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

slurp

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

teoma

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

ia_archiver

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

twiceler

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

msnbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

scrubby

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

robozilla

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

gigabot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-image

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-mobile

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yahoo-mmcrawler

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yahoo-blogs/v3.9

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

psbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-news

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-image

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-video

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-mobile

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

mediapartners-google

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

mediapartners(googlebot)

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

adsbot-google

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

haosouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

iaskspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yisouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yisouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

bytespider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://z.mafengwo.cn/mfw1.xml
sitemap http://z.mafengwo.cn/mfw2.xml
sitemap http://z.mafengwo.cn/mfw3.xml
sitemap http://z.mafengwo.cn/mfw4.xml
sitemap http://z.mafengwo.cn/mfw5.xml
sitemap http://z.mafengwo.cn/mfw6.xml
sitemap http://z.mafengwo.cn/mfw7.xml
sitemap http://z.mafengwo.cn/mfw8.xml
sitemap http://z.mafengwo.cn/mfw9.xml
sitemap http://z.mafengwo.cn/mfw10.xml
sitemap http://z.mafengwo.cn/mfw11-0.xml
sitemap http://z.mafengwo.cn/mfw12.xml
sitemap http://z.mafengwo.cn/mfw13.xml
sitemap http://z.mafengwo.cn/mfw14.xml
sitemap http://z.mafengwo.cn/sitemap.xml
Back to top

Warnings

  • 12 invalid lines.
Back to top