Log In Sign Up

huoche.mafengwo.cn
robots.txt

Robots Exclusion Standard data for huoche.mafengwo.cn

Resource Scan

Scan Details

Site Domain huoche.mafengwo.cn
Base Domain mafengwo.cn
Scan Status Ok
Last Scan2024-10-21T17:24:35+00:00
Next Scan 2024-11-20T17:24:35+00:00

Last Scan

Scanned2024-10-21T17:24:35+00:00
URL https://huoche.mafengwo.cn/robots.txt
Domain IPs 43.175.236.64
Response IP 43.175.236.64
Found Yes
Hash e8bd284852319569b16726fc01efbff18c4b6e81de5d1fdfecba5e2bb51622c4
SimHash 6c5552667433

Groups

baiduspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

sosospider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

sogou spider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yodaobot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

bingbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

slurp

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

teoma

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

ia_archiver

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

twiceler

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

msnbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

scrubby

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

robozilla

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

gigabot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-image

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-mobile

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yahoo-mmcrawler

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yahoo-blogs/v3.9

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

psbot

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-news

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-image

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-video

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

googlebot-mobile

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

mediapartners-google

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

mediapartners(googlebot)

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

adsbot-google

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

haosouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

iaskspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yisouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

yisouspider

Rule Path
Disallow /upimage/
Disallow /swf/
Disallow /app/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://huoche.mafengwo.cn/mfw1.xml
sitemap http://huoche.mafengwo.cn/mfw2-0.xml
sitemap http://huoche.mafengwo.cn/mfw2-1.xml
sitemap http://huoche.mafengwo.cn/mfw2-2.xml
sitemap http://huoche.mafengwo.cn/mfw2-3.xml
sitemap http://huoche.mafengwo.cn/mfw3.xml
sitemap http://huoche.mafengwo.cn/mfw4.xml
sitemap http://huoche.mafengwo.cn/mfw5.xml
sitemap http://huoche.mafengwo.cn/mfw6.xml
sitemap http://huoche.mafengwo.cn/mfw7-0.xml
sitemap http://huoche.mafengwo.cn/mfw7-1.xml
sitemap http://huoche.mafengwo.cn/mfw7-2.xml
sitemap http://huoche.mafengwo.cn/mfw7-3.xml
sitemap http://huoche.mafengwo.cn/sitemap.xml
Back to top

Warnings

  • 12 invalid lines.
Back to top