vufold.co.uk
robots.txt

Robots Exclusion Standard data for vufold.co.uk

Resource Scan

Scan Details

Site Domain vufold.co.uk
Base Domain vufold.co.uk
Scan Status Ok
Last Scan2025-08-20T06:57:05+00:00
Next Scan 2025-09-19T06:57:05+00:00

Last Scan

Scanned2025-08-20T06:57:05+00:00
URL https://vufold.co.uk/robots.txt
Redirect https://www.vufold.co.uk/robots.txt
Redirect Domain www.vufold.co.uk
Redirect Base vufold.co.uk
Domain IPs 104.26.8.206, 104.26.9.206, 172.67.74.20, 2606:4700:20::681a:8ce, 2606:4700:20::681a:9ce, 2606:4700:20::ac43:4a14
Redirect IPs 104.26.8.206, 104.26.9.206, 172.67.74.20, 2606:4700:20::681a:8ce, 2606:4700:20::681a:9ce, 2606:4700:20::ac43:4a14
Response IP 104.26.9.206
Found Yes
Hash f564346fb5a39013e67702b05a4a065f330be687daaa6c9c847c4232c022dd34
SimHash 669733c62b3d

Groups

*

Rule Path
Disallow /stores/store/
Disallow /index.php/
Disallow /errors/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /elasticsuite_cms/
Disallow /cdn-cgi/
Disallow /search/ajax/suggest/?q*
Disallow /*.php$
Disallow /*?price
Disallow /*%26price
Disallow /*?blind_compatibility
Disallow /*%26blind_compatibility
Disallow /*?bottom_track
Disallow /*%26bottom_track
Disallow /*?color
Disallow /*%26color
Disallow /*?colour
Disallow /*%26colour
Disallow /*?custom_product_type
Disallow /*%26custom_product_type
Disallow /*?door_design
Disallow /*%26door_design
Disallow /*?french_door_supreme_only
Disallow /*%26french_door_supreme_only
Disallow /*?glass_type
Disallow /*%26glass_type
Disallow /*?glazing_option
Disallow /*%26glazing_option
Disallow /*?handle_category
Disallow /*%26handle_category
Disallow /*?lever_length
Disallow /*%26lever_length
Disallow /*?manufacturer
Disallow /*%26manufacturer
Disallow /*?material
Disallow /*%26material
Disallow /*?number_of_door_stops
Disallow /*%26number_of_door_stops
Disallow /*?number_of_magnet_pairs
Disallow /*%26number_of_magnet_pairs
Disallow /*?open_in_out
Disallow /*%26open_in_out
Disallow /*?open_left_right
Disallow /*%26open_left_right
Disallow /*?projection
Disallow /*%26projection
Disallow /*?rooflight_size
Disallow /*%26rooflight_size
Disallow /*?size
Disallow /*%26size

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

vebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.vufold.co.uk/media/blog_sitemap_other.xml
sitemap https://www.vufold.co.uk/media/sitemap_category.xml
sitemap https://www.vufold.co.uk/media/sitemap_product.xml
sitemap https://www.vufold.co.uk/media/sitemap_other.xml
sitemap https://www.vufold.co.uk/media/sitemap_cms.xml

Comments

  • --------------------------------------------
  • Magento 2 Development : youweagency.co.uk
  • Digital Marketing : ignitionsearch.co.uk
  • --------------------------------------------
  • Crawler Setup
  • Paths
  • AJAX Search
  • Exclude Filters
  • VuFold Specific Filters
  • SEO Bots
  • Search Crawlers
  • XML Sitemaps for Case Studies (Manual)
  • XML Sitemaps by Mageworx (Auto)

Warnings

  • `host` is not a known field.