Log In Sign Up

basicfabrics.com
robots.txt

Robots Exclusion Standard data for basicfabrics.com

Resource Scan

Scan Details

Site Domain basicfabrics.com
Base Domain basicfabrics.com
Scan Status Ok
Last Scan2025-10-23T08:35:52+00:00
Next Scan 2025-11-06T08:35:52+00:00

Last Scan

Scanned2025-10-23T08:35:52+00:00
URL https://basicfabrics.com/robots.txt
Domain IPs 154.117.147.187, 162.215.226.6
Response IP 154.117.147.187
Found Yes
Hash 9bcb22503468d6ad630360712f0aa7ffad475d789f594af43e703b7e9aea5d9f
SimHash 2b805e1961f4

Groups

*

Rule Path
Allow /content/
Allow /images/
Allow /fonts/
Allow /scripts/
Allow /css/
Allow /*.js$
Allow /*.css$
Disallow /admin/
Disallow /cms/
Disallow /umbraco/
Disallow /App_Data/
Disallow /bin/
Disallow /obj/
Disallow /temp/
Disallow /backup/
Disallow /elmah.axd
Disallow /trace.axd
Disallow /WebResource.axd
Disallow /ScriptResource.axd
Disallow /login.aspx
Disallow /logout.aspx
Disallow /register.aspx
Disallow /account/
Disallow /myorders.aspx
Disallow /wishlist.aspx
Disallow /cart.aspx
Disallow /checkout.aspx
Disallow /payment/
Disallow /order-confirmation.aspx
Disallow /search
Disallow /search.aspx
Disallow /internal/
Disallow /api/private/
Disallow /admin-api/
Back to top

Other Records

Field Value
sitemap https://basicfabrics.com/sitemap.xml
Back to top

Comments

  • robots.txt for https://basicfabrics.com/
  • Last updated: 2025-09-19
  • --- Keep critical assets crawlable for proper rendering ---
  • --- Block sensitive/system paths (typical ASP.NET + ecommerce) ---
  • ASP.NET handlers and diagnostics
  • User/account & checkout
  • Search & internal utilities
  • --- Optional: de-duplicate messy parameter URLs (keep products/categories open) ---
  • If you see index bloat from faceted parameters, uncomment specific lines below.
  • Be conservative—blocking too much can hurt discovery.
  • Disallow: /*?*sort=
  • Disallow: /*?*page=
  • Disallow: /*?*view=
  • Disallow: /*?*sessionid=
  • Disallow: /*&utm_
  • Disallow: /*?utm_
  • --- Sitemaps ---
  • If you have multiple sitemaps, list them all:
  • Sitemap: https://basicfabrics.com/sitemap-products.xml
  • Sitemap: https://basicfabrics.com/sitemap-categories.xml
  • Sitemap: https://basicfabrics.com/sitemap-images.xml
Back to top