e-hardware.co.uk
robots.txt

Robots Exclusion Standard data for e-hardware.co.uk

Resource Scan

Scan Details

Site Domain e-hardware.co.uk
Base Domain e-hardware.co.uk
Scan Status Ok
Last Scan2025-11-07T19:33:42+00:00
Next Scan 2025-12-07T19:33:42+00:00

Last Scan

Scanned2025-11-07T19:33:42+00:00
URL https://e-hardware.co.uk/robots.txt
Redirect https://www.e-hardware.co.uk/robots.txt
Redirect Domain www.e-hardware.co.uk
Redirect Base e-hardware.co.uk
Domain IPs 104.20.18.245, 172.66.163.136, 2606:4700:10::6814:12f5, 2606:4700:10::ac42:a388
Redirect IPs 104.20.18.245, 172.66.163.136, 2606:4700:10::6814:12f5, 2606:4700:10::ac42:a388
Response IP 104.20.18.245
Found Yes
Hash 1fc19df3d702a1b28d682defb1590f905300d532b5d01bd571b2b0156d9fabca
SimHash c7a4ca0ac69a

Groups

adidxbot
*

Rule Path
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?price=
Disallow /*bagsize--
Disallow /*brand--
Disallow /*cetested--
Disallow /*color--
Disallow /*colourtemperature--
Disallow /*finish--
Disallow /*fixedcentre--
Disallow /*gauge_--
Disallow /*headtype--
Disallow /*insuranceapproved--
Disallow /*key_type--
Disallow /*category--
Disallow /*manufacturer--
Disallow /*material--
Disallow /*packquantity--
Disallow /*producttype--
Disallow /*screwdiameter--
Disallow /*size--
Disallow /*watt--
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /review/
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$

petalbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

majestic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

test-bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.e-hardware.co.uk/sitemap.xml

Comments

  • --- e-Hardware robots.txt file ---
  • --- adidxbot follows same rules as wildcard ---
  • --- Default Magento 2 instructions ---
  • --- Disallow common Magento files in the root directory ---
  • --- Disallow User Account & Checkout Pages ---
  • --- Disallow Catalog Search Pages ---
  • --- Disallow URL Filter Searches ---
  • --- Disallow Facetted Navigation Attributes ---
  • --- Disallow Directories ---
  • --- Disallow Duplicate Content ---
  • --- Server Settings ---
  • --- Disallow general technical directories and files on a server ---
  • --- Disallow version control folders and others ---
  • --- Disallow & Control Naughty Bots ---
  • e-Hardware Sitemap