Log In Sign Up

mafengwo.cn
robots.txt

Robots Exclusion Standard data for mafengwo.cn

Resource Scan

Scan Details

Site Domain mafengwo.cn
Base Domain mafengwo.cn
Scan Status Ok
Last Scan2024-06-28T08:52:15+00:00
Next Scan 2024-07-05T08:52:15+00:00

Last Scan

Scanned2024-06-28T08:52:15+00:00
URL https://www.mafengwo.cn/robots.txt
Domain IPs 43.132.81.61, 43.159.70.125, 43.159.71.118
Response IP 43.159.71.118
Found Yes
Hash 73edbe4a6cac70d945a04a183adb9292d701afa83b09ed0ee934acfb0845ba44
SimHash 2d5618677437

Groups

baiduspider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

bytespider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

sosospider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

sogou web spider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

yodaobot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

bingbot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

slurp

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

teoma

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

ia_archiver

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

twiceler

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

msnbot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

scrubby

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

robozilla

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

gigabot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-image

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-mobile

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

yahoo-mmcrawler

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

yahoo-blogs/v3.9

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

psbot

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-news

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-image

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-video

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

googlebot-mobile

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

mediapartners-google

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

mediapartners(googlebot)

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

adsbot-google

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

haosouspider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

iaskspider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

yisouspider

Rule Path
Disallow /musi
Disallow /boo
Disallow /secre
Disallow /ran
Disallow /order_cen
Disallow /hotel_z
Disallow /sales/or
Disallow /u/*.html

*

Rule Path
Disallow /
Disallow /po
Back to top

Other Records

Field Value
sitemap http://www.mafengwo.cn/sitemapIndex.xml
Back to top

Warnings

  • 27 invalid lines.
Back to top