made-in-china.com
robots.txt
Robots Exclusion Standard data for made-in-china.com
Resource Scan
Scan Details
Site Domain | made-in-china.com |
Base Domain | made-in-china.com |
Scan Status | Ok |
Last Scan | 2024-09-22T17:13:59+00:00 |
Next Scan | 2024-10-22T17:13:59+00:00 |
Last Scan
Scanned | 2024-09-22T17:13:59+00:00 |
URL | https://made-in-china.com/robots.txt |
Redirect | https://www.made-in-china.com/robots.txt |
Redirect Domain | www.made-in-china.com |
Redirect Base | made-in-china.com |
Domain IPs | 213.61.193.204 |
Redirect IPs | 104.18.33.117, 172.64.154.139 |
Response IP | 104.18.33.117 |
Found | Yes |
Hash | eac41287f89a440995af15f7e8f6c3ab3e303ba5dd98b11f3ac9591686b22bda |
SimHash | 9b117394121b |
Groups
*
adsbot-google
adsbot-google-mobile
Rule | Path |
---|---|
Disallow | /*.do$ |
Disallow | /*.do? |
Disallow | /*.action$ |
Disallow | /*.action? |
Disallow | /sendInquiry/ |
Disallow | /browsing-history/ |
Disallow | /advanced-search/ |
Disallow | /member/ |
Disallow | /rss/ |
Disallow | /ad?url= |
Disallow | /products-search/find-china-products/*-1.html |
Disallow | /errorDocs/ |
Disallow | /multi-search/ |
Disallow | */recommend/alsoLiked/* |
Disallow | /showroom/*/prod-question-count |
Disallow | /join/?sourceType |
Disallow | /start-order.html?from= |
Disallow | /go/ |
Disallow | /company-search/ |
Disallow | /deals/listProdDealsCoupon$ |
Disallow | /deals/listProdDealsCoupon? |
*
Rule | Path |
---|---|
Disallow | /cs/ |
Disallow | /dt/ |
Disallow | /price-search/ |
Disallow | /quality-china-product/productSearch |
Disallow | /*html?* |
baiduspider
Rule | Path |
---|---|
Disallow | /Health-Medicine-Catalog/Sex-Product.html |
Disallow | /Toys-Catalog/Adult-Toys.html |
Disallow | /Apparel-Accessories-Catalog/* |
Disallow | /products-search/hot-china-products/* |
Disallow | /manufacturers/* |
Disallow | /factory/* |
Disallow | /price/* |
*
Rule | Path |
---|---|
Disallow | /video-channel/view-* |
Disallow | /video-channel/category-* |