Log In Sign Up

warmyourfloor.com
robots.txt

Robots Exclusion Standard data for warmyourfloor.com

Resource Scan

Scan Details

Site Domain warmyourfloor.com
Base Domain warmyourfloor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-01T13:30:55+00:00
Next Scan 2025-12-30T13:30:55+00:00

Last Successful Scan

Scanned2023-08-17T22:39:52+00:00
URL https://warmyourfloor.com/robots.txt
Redirect https://www.warmyourfloor.com/robots.txt
Redirect Domain www.warmyourfloor.com
Redirect Base warmyourfloor.com
Domain IPs 192.124.249.28
Redirect IPs 192.124.249.28
Response IP 192.124.249.28
Found Yes
Hash 4d964da617ab54ea2cce829c674797c6c96e511e3894e500ac84293c2cf82b48
SimHash b9207d232595

Groups

*

Rule Path
Allow /elastic.php
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /index.php/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*.php$
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Back to top

Other Records

Field Value
sitemap https://www.warmyourfloor.com/pub/sitemap_category_category.xml
sitemap https://www.warmyourfloor.com/pub/sitemap_product_product.xml
sitemap https://www.warmyourfloor.com/pub/sitemap_cms_cms.xml
sitemap https://www.warmyourfloor.com/pub/sitemap_additional_link_addition.xml
Back to top

Comments

  • ****************************************************************************
  • robots.txt
  • : Robots, spiders, and search engines use this file to detmine which
  • content they should *not* crawl while indexing your website.
  • : This system is called "The Robots Exclusion Standard."
  • : It is strongly encouraged to use a robots.txt validator to check
  • for valid syntax before any robots read it!
  • Examples:
  • Instruct all robots to stay out of the admin area.
  • : User-agent: *
  • : Disallow: /admin/
  • Restrict Google and MSN from indexing your images.
  • : User-agent: Googlebot
  • : Disallow: /images/
  • : User-agent: MSNBot
  • : Disallow: /images/
  • ***************************************************************************
  • Directories
  • Paths (clean URLs)
  • Disallow: /catalog/product_compare/
  • Disallow: /wishlist/
  • Files
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • CVS, SVN directory and dump files
Back to top