Log In Sign Up

mrd.dhgate.com
robots.txt

Robots Exclusion Standard data for mrd.dhgate.com

Resource Scan

Scan Details

Site Domain mrd.dhgate.com
Base Domain dhgate.com
Scan Status Ok
Last Scan2024-10-18T07:11:52+00:00
Next Scan 2024-11-17T07:11:52+00:00

Last Scan

Scanned2024-10-18T07:11:52+00:00
URL https://mrd.dhgate.com/robots.txt
Domain IPs 152.199.34.4, 2606:2800:249:d3df:2bcc:879b:b5f2:587c
Response IP 152.199.34.4
Found Yes
Hash 5a76b081e35fb00c7657e2239421e67065d9d09e3688e21ee701ddf64ffee294
SimHash e37f5bdec7f1

Groups

*

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /omniture/omniture.do
Disallow /im/dhtalk.do
Disallow /product/brandreport.do
Disallow /product/productdisplay.do
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /cart/
Disallow /csmsg/
Disallow /dhrec/
Disallow /product-images/
Disallow /wholesale/store/
Disallow /w/
Disallow /promotionproduct/
Disallow /seller-feedback/
Disallow /%21forums/
Disallow /*?

googlebot

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

yandexbot

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

bingbot

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

ia_archiver

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

naverbot

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

yeti

Rule Path
Allow /*?f=bm
Allow /*?utm_source
Allow /*?_escaped_fragment_=
Disallow /sellerPromise.do
Disallow /search.do
Disallow /promoproduct.do
Disallow /disc.do
Disallow /dcp/
Disallow /mydhgate/
Disallow /loadShipList.do?
Disallow /logodata.do
Disallow /%21forums/
Disallow /dhrec/
Disallow /w/
Disallow /product/shippingpayment.do
Disallow /product/mobileprict.do
Disallow /product/productguaranteedajax.do
Disallow /product/inventory.do
Disallow /product/getstprodinfo.do
Disallow /product/productreview.do
Disallow /product/displayorder.do
Disallow /product/getonlinestatus.do
Disallow /*?

googlebot-image

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou wap spider

Rule Path
Disallow /

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

crescent internet toolpak

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

htdig

Rule Path
Disallow /

httrack

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

internetseer.com

Rule Path
Disallow /

iupui

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

psbot

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

rpt-httpclient

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

tamu

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

ultraseek

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webemailextractor

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://m.dhgate.com/sitemapseo/product_sitemap__index.xml
Back to top

Comments

  • Crawlers which we'd rather not have.
  • Naverbot Yeti
  • Sitemap
Back to top