damart.co.uk
robots.txt

Robots Exclusion Standard data for damart.co.uk

Resource Scan

Scan Details

Site Domain damart.co.uk
Base Domain damart.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-13T02:13:34+00:00
Next Scan 2026-03-13T02:13:34+00:00

Last Successful Scan

Scanned2023-10-26T17:54:37+00:00
URL https://damart.co.uk/robots.txt
Redirect https://www.damart.co.uk/robots.txt
Redirect Domain www.damart.co.uk
Redirect Base damart.co.uk
Domain IPs 195.64.164.87
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 65c2de846817df9f3d69250222f390d18b4bf2e0d378d60966e8f8aa3993b8c2
SimHash ef645b8205e2

Groups

*

Rule Path
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /sendfriend/
Disallow /productalert/*
Disallow /catalog/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /?mode
Disallow /*?pr_page_id
Disallow /*.php$
Disallow /*SID%3D
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /review/
Disallow /c-*?*activite_type*=*
Disallow /c-*?*activity*=*
Disallow /c-*?*bottom_length_label*=*
Disallow /c-*?*bottom_size_label*=*
Disallow /c-*?*brand_filter*=*
Disallow /c-*?*categorie*=*
Disallow /c-*?*category_gear*=*
Disallow /c-*?*climate*=*
Disallow /c-*?*closing_mode_donning*=*
Disallow /c-*?*collar*=*
Disallow /c-*?*color_filterable*=*
Disallow /c-*?*eco_collection*=*
Disallow /c-*?*erin_recommends*=*
Disallow /c-*?*features_bags*=*
Disallow /c-*?*fit_shape*=*
Disallow /c-*?*fit_underwired*=*
Disallow /c-*?*format*=*
Disallow /c-*?*gender*=*
Disallow /c-*?*innotechno_level*=*
Disallow /c-*?*innovation*=*
Disallow /c-*?*manufacturer*=*
Disallow /c-*?*material*=*
Disallow /c-*?*new*=*
Disallow /c-*?*other_size_label*=*
Disallow /c-*?*pattern*=*
Disallow /c-*?*performance_fabric*=*
Disallow /c-*?*price*=*
Disallow /c-*?*product_typology*=*
Disallow /c-*?*purpose*=*
Disallow /c-*?*sale*=*
Disallow /c-*?*shoe_size_label*=*
Disallow /c-*?*size_bust*=*
Disallow /c-*?*size_cup*=*
Disallow /c-*?*sleeve*=*
Disallow /c-*?*sleeve_type*=*
Disallow /c-*?*strap_bags*=*
Disallow /c-*?*style_bags*=*
Disallow /c-*?*style_bottom*=*
Disallow /c-*?*style_general*=*
Disallow /c-*?*top_size_label*=*
Disallow /c-*?*towel_size_label*=*
Disallow /catalog/category/view/id/*?*
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*.git
Disallow /*.CVS
Disallow /*.zip$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /product?*

Other Records

Field Value
sitemap https://www.damart.co.uk/media/nep_en_gb_cms.xml
sitemap https://www.damart.co.uk/media/nep_en_gb_other.xml
sitemap https://www.damart.co.uk/media/nep_en_gb_product.xml
sitemap https://www.damart.co.uk/media/nep_en_gb_category.xml

Comments

  • Disable checkout & customer account
  • Disable Search pages
  • Disallow URL Filter Searches
  • Disallow URL Redirections
  • Restrict Technical Files
  • Restrict Technical Directories
  • Disable Tag & Review (Avoid duplicate content)
  • Disable facets (Avoid crawl flooding)
  • For all categories and all QS params
  • Disable sorting (Avoid duplicate content)
  • Disable version control folders and others dev related files
  • pre NEP old URLs