scrubsandbeyond.com
robots.txt

Robots Exclusion Standard data for scrubsandbeyond.com

Resource Scan

Scan Details

Site Domain scrubsandbeyond.com
Base Domain scrubsandbeyond.com
Scan Status Ok
Last Scan2025-09-13T06:14:59+00:00
Next Scan 2025-10-13T06:14:59+00:00

Last Scan

Scanned2025-09-13T06:14:59+00:00
URL https://scrubsandbeyond.com/robots.txt
Redirect https://www.scrubsandbeyond.com/robots.txt
Redirect Domain www.scrubsandbeyond.com
Redirect Base scrubsandbeyond.com
Domain IPs 151.101.3.52
Redirect IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Response IP 146.75.47.52
Found Yes
Hash dae31721639a199fa13bf64d8c4c0817af7cef597c17852a1bd722e5142b1b04
SimHash 0d4c6b2e45f3

Groups

*

Rule Path
Disallow /admin/
Disallow /cron.php
Disallow /error_log
Disallow /get.php
Disallow /*.aspx
Disallow /*.do
Disallow /review/
Disallow /mobile/
Disallow /category/
Disallow /catalog/
Disallow /*.html.html
Disallow /*.ashx?
Disallow /*.axd?d
Disallow /*/xml/
Disallow /webservices/
Disallow /shipping/tracking/popup/hash/
Disallow /product/
Disallow /test
Disallow /p2p/
Disallow /3/
Disallow /*?us=y
Disallow /*.jsp
Disallow /*class%3D
Disallow /*rSort
Disallow /*.asp
Disallow /wishlist/index/add/
Disallow /catalogsearch
Disallow /*price%3D
Disallow /*brand%3D
Disallow /*product_list_order%3D
Disallow /*color_group%3D
Disallow /*brand_collection%3D
Disallow /*type%3D
Disallow /*item_type%3D
Disallow /*cat%3D
Disallow /*gender%3D
Disallow /*size_category%3D
Disallow /*fabric%3D

Other Records

Field Value
sitemap https://www.scrubsandbeyond.com/sitemaps/sitemap_products_sab.xml
sitemap https://www.scrubsandbeyond.com/sitemaps/sitemap_categories_sab.xml
sitemap https://www.scrubsandbeyond.com/sitemaps/blogs.xml

Comments

  • GENERAL SETTINGS For MAGENTO
  • Do not index the page Magento admin
  • Do not index the shared files Magento
  • Reduce robots traffic