cladcodecking.co.uk
robots.txt

Robots Exclusion Standard data for cladcodecking.co.uk

Resource Scan

Scan Details

Site Domain cladcodecking.co.uk
Base Domain cladcodecking.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-30T21:15:12+00:00
Next Scan 2026-02-06T21:15:12+00:00

Last Successful Scan

Scanned2025-12-30T19:53:40+00:00
URL https://cladcodecking.co.uk/robots.txt
Redirect https://www.cladco.co.uk/robots.txt
Redirect Domain www.cladco.co.uk
Redirect Base cladco.co.uk
Domain IPs 104.26.6.62, 104.26.7.62, 172.67.69.146, 2606:4700:20::681a:63e, 2606:4700:20::681a:73e, 2606:4700:20::ac43:4592
Redirect IPs 104.26.14.173, 104.26.15.173, 172.67.71.210, 2606:4700:20::681a:ead, 2606:4700:20::681a:fad, 2606:4700:20::ac43:47d2
Response IP 172.67.71.210
Found Yes
Hash b854af4a5ddc431818124efd32f31e9e9737a1a8b457f669beb0cff0cea131c5
SimHash bd11435e028a

Groups

*

Rule Path
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /control/
Disallow /customize/
Disallow /customer/
Disallow /catalogsearch/
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*?SID=
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /*?*color=
Disallow /*?*profile=
Disallow /*?*length=
Disallow /*?*finish=
Disallow /*?*thickness=
Disallow /*?*flashing_type=
Disallow /*?*accessory_type=
Disallow /*?*frame_type=
Disallow /*?*cladco_product_type=
Disallow /*?*screw_drive_type=
Disallow /*?*screw_type=
Disallow /*?*punched=
Disallow /*?*depth=
Disallow /*?*balustrade_size=
Disallow /*?*rooflight_length=
Disallow /*?*product_range=
Disallow /*?*fixings_length=
Disallow /*?*guttering_type=
Disallow /*?*trade_products=

Other Records

Field Value
sitemap https://www.cladco.co.uk/sitemap.xml

Comments

  • Paths (clean URLs)
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • CVS, SVN directory and dump files