dlx.co.uk
robots.txt
Robots Exclusion Standard data for dlx.co.uk
Resource Scan
Scan Details
| Site Domain | dlx.co.uk |
| Base Domain | dlx.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-11-11T03:49:17+00:00 |
| Next Scan | 2025-12-11T03:49:17+00:00 |
Last Scan
| Scanned | 2025-11-11T03:49:17+00:00 |
| URL | https://dlx.co.uk/robots.txt |
| Redirect | https://www.dlx.co.uk/robots.txt |
| Redirect Domain | www.dlx.co.uk |
| Redirect Base | dlx.co.uk |
| Domain IPs | 45.60.124.183, 45.60.130.183 |
| Redirect IPs | 45.60.126.183 |
| Response IP | 45.60.126.183 |
| Found | Yes |
| Hash | afcc0a6a9e6e8fb7991fb8eca9eb86bf17751d9af453742e6bfecdccb6d303fa |
| SimHash | 01c84852c8b5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /directory/ |
| Disallow | /downloader/ |
| Disallow | /install/ |
| Disallow | /js/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /pkginfo/ |
| Disallow | /private/ |
| Disallow | /setup/ |
| Disallow | /skin/ |
| Disallow | /update/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /admin/ |
| Disallow | */api/ |
| Disallow | */catalog/category/view/ |
| Disallow | */catalog/product/view/ |
| Disallow | */catalogsearch |
| Disallow | */checkout |
| Disallow | */customer/ |
| Disallow | */newsletter |
| Disallow | */order/ |
| Disallow | */poll/ |
| Disallow | */report/ |
| Disallow | */review/ |
| Disallow | */rma/ |
| Disallow | */sendfriend |
| Disallow | */wishlist |
| Disallow | /cron |
| Disallow | /cron.php |
| Disallow | */cat/* |
| Disallow | /*/pricematch/* |
| Disallow | /*/colour/* |
| Disallow | /*/show/* |
| Disallow | /*/size/* |
| Disallow | /*/price/* |
| Disallow | */sort-by/* |
| Disallow | /*?*product_list_dir= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*.php |
| Disallow | /*.sh$ |
| Disallow | /*.CSV$ |
| Disallow | /*.csv$ |
| Disallow | /*.gitignore$ |
| Disallow | /*.sample$ |
| Disallow | /*.sql$ |
| Disallow | /*.zip$ |
| Disallow | /*%26carrier%3D* |
| Disallow | /*%26cat%3D* |
| Disallow | /*%26color_filter%3D* |
| Disallow | /*%26display_size%3D* |
| Disallow | /*%26name%3D* |
| Disallow | /*%26network%3D* |
| Disallow | /*%26os%3D* |
| Disallow | /*%26price%3D* |
| Disallow | /*%26timestamp%3D* |
| Disallow | /*%26top_seller%3D* |
| Disallow | /*?SID=* |
| Disallow | /*?___SID=* |
| Disallow | /*?___store=* |
| Disallow | /*?carrier=* |
| Disallow | /*?cat=* |
| Disallow | /*?color_filter=* |
| Disallow | /*?display_size=* |
| Disallow | /*?name=* |
| Disallow | /*?network=* |
| Disallow | /*?os=* |
| Disallow | /*?PageSpeed=noscript |
| Disallow | /*?price=* |
| Disallow | /*?timestamp=* |
| Disallow | /*?top_seller=* |
| Disallow | /*?size_legacy=* |
| Disallow | /*?base_color=* |
| Disallow | /*?manufacturer=* |
| Disallow | /*?insulation_type=* |
| Disallow | /*?gender=* |
| Disallow | /*?p=2&size_legacy=* |
| Disallow | *?size_legacy=* |
| Disallow | *?base_color=* |
| Disallow | *?manufacturer=* |
| Disallow | *?insulation_type=* |
| Disallow | *?gender=* |
| Disallow | *?p=2&size_legacy=* |
| Disallow | /*/new_product_type/* |
| Disallow | /*/product_subtype/* |
| Disallow | /*?category_id=* |
| Disallow | /*?adnetwork=* |
| Disallow | /%26adnetwork%3D |
| Disallow | /?affc= |
| Disallow | /%26affc%3D |
| Disallow | /*?cto_pld=* |
| Disallow | /%26cto_pld%3D |
| Disallow | /*?ved=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?search=sf-* |
| Allow | /*?p= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dlx.co.uk/sitemap.xml |
Warnings
- 2 invalid lines.
Comments