thehempshop.co.uk
robots.txt
Robots Exclusion Standard data for thehempshop.co.uk
Resource Scan
Scan Details
Site Domain | thehempshop.co.uk |
Base Domain | thehempshop.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-25T23:11:50+00:00 |
Next Scan | 2024-10-25T23:11:50+00:00 |
Last Scan
Scanned | 2024-09-25T23:11:50+00:00 |
URL | https://thehempshop.co.uk/robots.txt |
Redirect | https://www.thehempshop.co.uk/robots.txt |
Redirect Domain | www.thehempshop.co.uk |
Redirect Base | thehempshop.co.uk |
Domain IPs | 192.124.249.129 |
Redirect IPs | 192.124.249.129 |
Response IP | 192.124.249.129 |
Found | Yes |
Hash | 1e2c9b8e80f05b401cb859b5ca0afcad79234e2da017847c1279d36939926001 |
SimHash | fb1458c0f172 |
Groups
*
Rule | Path |
---|---|
Disallow | /catalogsearch/ |
Disallow | /directory/currency/ |
Disallow | /review/product/list/ |
Disallow | /customer/account/login/referer/ |
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /tag/ |
Disallow | /review/ |
Disallow | /catalog/product_compare/ |
Disallow | /catalog/category/view/ |
Disallow | /sendfriend/ |
Disallow | /enable-cookies/ |
Disallow | /LICENSE.txt |
Disallow | /LICENSE.html |
Disallow | /skin/ |
Disallow | /directory/ |
Disallow | /customer/ |
Disallow | /index.php/ |
Disallow | /wishlist/ |
Disallow | /admin/ |
Disallow | /checkout/ |
Disallow | /*?p= |
Disallow | /*%26p%3D |
Disallow | /*?price= |
Disallow | /*%26price%3D |
Disallow | /*?color= |
Disallow | /*%26color%3D |
Disallow | /*?limit= |
Disallow | /*%26limit%3D |
Disallow | /*?order= |
Disallow | /*%26order%3D |
Disallow | /*?dir= |
Disallow | /*%26dir%3D |
Disallow | /where/ |
Disallow | /w/ |
Disallow | /*?packaging_type=* |
Disallow | /*%26packaging_type%3D* |
Disallow | /*%26prod_classification%3D* |
Disallow | /*?prod_classification=* |
Disallow | /*?fabric_type_=* |
Disallow | /*%26fabric_type_%3D* |
Disallow | /*?cat=* |
Disallow | /*%26cat%3D* |
Disallow | /*?fabric_suggested_uses=* |
Disallow | /*%26fabric_suggested_uses%3D* |
Disallow | /*?gender=* |
Disallow | /*%26gender%3D* |
Disallow | /*?fabric_composition=* |
Disallow | /*%26fabric_composition%3D* |
Disallow | /*?use_batteries=* |
Disallow | /*%26use_batteries%3D* |
Disallow | /*?price=* |
Disallow | /*%26price%3D* |
adsbot-google
Rule | Path |
---|---|
Disallow | /cbd-oil-uk* |
Disallow | /provacan* |
Disallow | /cannabigold* |
Disallow | /cibdol* |
Disallow | /biobloom* |
Disallow | /bio-bloom* |
Disallow | /love-hemp* |
Disallow | /hemptouch* |
Disallow | /phytalize* |
Disallow | /impact-cbd* |
Disallow | /*cbd* |
adsbot-google-mobile
Rule | Path |
---|---|
Disallow | /cbd-oil-uk* |
Disallow | /provacan* |
Disallow | /cannabigold* |
Disallow | /cibdol* |
Disallow | /biobloom* |
Disallow | /bio-bloom* |
Disallow | /love-hemp* |
Disallow | /hemptouch* |
Disallow | /phytalize* |
Disallow | /impact-cbd* |
Disallow | /*cbd* |
bingbot
Rule | Path |
---|---|
Disallow | /catalogsearch/ |
Disallow | /*?packaging_type=* |
Disallow | /*%26packaging_type%3D* |
Disallow | /*%26prod_classification%3D* |
Disallow | /*?prod_classification=* |
Disallow | /*?fabric_type_=* |
Disallow | /*%26fabric_type_%3D* |
Disallow | /*?cat=* |
Disallow | /*%26cat%3D* |
Disallow | /*?fabric_suggested_uses=* |
Disallow | /*%26fabric_suggested_uses%3D* |
Disallow | /*?gender=* |
Disallow | /*%26gender%3D* |
Disallow | /*?fabric_composition=* |
Disallow | /*%26fabric_composition%3D* |
Disallow | /*?use_batteries=* |
Disallow | /*%26use_batteries%3D* |
Disallow | /*?price=* |
Disallow | /*%26price%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
gptbot
Rule | Path |
---|---|
Disallow | /catalogsearch/ |
Disallow | /*?packaging_type=* |
Disallow | /*%26packaging_type%3D* |
Disallow | /*%26prod_classification%3D* |
Disallow | /*?prod_classification=* |
Disallow | /*?fabric_type_=* |
Disallow | /*%26fabric_type_%3D* |
Disallow | /*?cat=* |
Disallow | /*%26cat%3D* |
Disallow | /*?fabric_suggested_uses=* |
Disallow | /*%26fabric_suggested_uses%3D* |
Disallow | /*?gender=* |
Disallow | /*%26gender%3D* |
Disallow | /*?fabric_composition=* |
Disallow | /*%26fabric_composition%3D* |
Disallow | /*?use_batteries=* |
Disallow | /*%26use_batteries%3D* |
Disallow | /*?price=* |
Disallow | /*%26price%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /catalogsearch/ |
Disallow | /*?packaging_type=* |
Disallow | /*%26packaging_type%3D* |
Disallow | /*%26prod_classification%3D* |
Disallow | /*?prod_classification=* |
Disallow | /*?fabric_type_=* |
Disallow | /*%26fabric_type_%3D* |
Disallow | /*?cat=* |
Disallow | /*%26cat%3D* |
Disallow | /*?fabric_suggested_uses=* |
Disallow | /*%26fabric_suggested_uses%3D* |
Disallow | /*?gender=* |
Disallow | /*%26gender%3D* |
Disallow | /*?fabric_composition=* |
Disallow | /*%26fabric_composition%3D* |
Disallow | /*?use_batteries=* |
Disallow | /*%26use_batteries%3D* |
Disallow | /*?price=* |
Disallow | /*%26price%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Comments