dare2b.com
robots.txt

Robots Exclusion Standard data for dare2b.com

Resource Scan

Scan Details

Site Domain dare2b.com
Base Domain dare2b.com
Scan Status Ok
Last Scan2024-08-22T20:44:31+00:00
Next Scan 2024-09-21T20:44:31+00:00

Last Scan

Scanned2024-08-22T20:44:31+00:00
URL https://dare2b.com/robots.txt
Redirect https://www.dare2b.com/robots.txt
Redirect Domain www.dare2b.com
Redirect Base dare2b.com
Domain IPs 108.156.133.120, 108.156.133.6, 108.156.133.85, 108.156.133.97
Redirect IPs 108.156.133.120, 108.156.133.6, 108.156.133.85, 108.156.133.97
Response IP 108.156.133.6
Found Yes
Hash 23b54e3c1cc60873ca4c293a29552d435141d62cb7f4cd83d4a2331d328607b1
SimHash 2c949d412d38

Groups

*

Rule Path
Disallow */404/
Disallow */app/
Disallow */cgi-bin/
Disallow */downloader/
Disallow */includes/
Disallow */lib/
Disallow */pkginfo/
Disallow */report/
Disallow */magento/
Disallow */stats/
Disallow */var/
Disallow */home/
Disallow */index.php/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */control/
Disallow */contacts/
Disallow */customer/*
Disallow */wishlist/
Disallow */review/
Disallow */sendfriend/
Disallow */tag/
Disallow */search/?q=*
Disallow */search/*
Disallow */sales/
Disallow */enable-cookies/
Disallow *page_size*
Disallow */.a/*
Disallow *static.dare2b*
Disallow *data.dare2b*
Allow */sale/shop-by/activity/ski/$
Allow */sale/shop-by/activity/cycling/$
Allow */sale/shop-by/activity/outdoor/$
Allow */sale/shop-by/activity/active/$
Allow */ski-wear/ski-jackets/shop-by/colour_group/black/$
Disallow */*?p=*&
Disallow */?bvstate=pg*
Disallow */cron.php
Disallow */cron.sh
Disallow */error_log
Disallow */install.php
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */STATUS.txt
Disallow *price_saving_percent*
Disallow *price*
Disallow *newness*
Disallow *average_review_rating*
Disallow *promotional_category*
Disallow *recommended*
Disallow */shop-by/color/*
Disallow */shop-by/size/*
Disallow */shop-by/price/*
Disallow */shop-by/erin_recommends/*
Disallow */shop-by/promotion_en_gb/*
Disallow */shop-by/product_category/*
Disallow */shop-by/gender/*
Disallow */shop-by/promotional_category_en_gb/*
Disallow */shop-by/activity/*
Disallow */shop-by/season_code/*
Disallow */shop-by/price_saving_percent_en_gb/*
Disallow */shop-by/categories/*
Disallow */shop-by/leg_length/*
Disallow */shop-by/colour_group/*
Disallow */shop-by/price_en_gb/*
Disallow */shop-by/technology/*
Disallow */shop-by/fit/*
Disallow */shop-by/product_type/*
Disallow */shop-by/product_sub_category/*
Disallow */shop-by/price_saving_amount_en_gb/*
Disallow */shop-by/phrase/*
Disallow */shop-by/size_filter_en_gb/*
Disallow */shop-by/average_review_rating_en_gb/*
Disallow */shop-by/category/*
Disallow */shop-by/gender/*
Disallow */shop-by/product_type/*
Disallow */shop-by/product_sub_category/*
Disallow */shop-by/Sizes/*
Disallow */shop-by/sizes/*
Disallow */shop-by/activity/*
Disallow */shop-by/colour/*
Disallow */shop-by/colors/*
Disallow */shop-by/price/*
Disallow */shop-by/brand/*
Disallow */shop-by/features/*
Disallow */shop-by/age_group/*
Disallow */shop-by/percentage_saving/*
Disallow */shop-by/reviews_ratings/*
Disallow */shop-by/sale_price/*
Disallow */shop-by/technologies/*
Disallow */shop-by/size/*
Disallow */shop-by/colour_group/*
Disallow */product_sub_category/*
Disallow *catalog/product/cache*
Disallow *crumb.link*

Other Records

Field Value
sitemap https://www.dare2b.com/sitemap/sitemap-db-uk.xml
sitemap https://www.dare2b.com/ie/sitemap/sitemap-db-ie.xml
sitemap https://www.dare2b.com/de/sitemap/sitemap-db-de.xml
sitemap https://www.dare2b.com/row/sitemap/sitemap-db-row.xml
sitemap https://www.dare2b.com/fr/sitemap/sitemap-db-fr.xml

Comments

  • config.defaultStoreCode:db_uk# Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Exceptions
  • Paths (no clean URLs)
  • Files
  • Sort by
  • Shop By
  • Images on media
  • Misc
  • Sitemaps

Warnings

  • 1 invalid line.