becn.com
robots.txt

Robots Exclusion Standard data for becn.com

Resource Scan

Scan Details

Site Domain becn.com
Base Domain becn.com
Scan Status Ok
Last Scan2025-05-24T09:48:19+00:00
Next Scan 2025-06-07T09:48:19+00:00

Last Scan

Scanned2025-05-24T09:48:19+00:00
URL https://becn.com/robots.txt
Redirect https://www.qxo.com/robots.txt
Redirect Domain www.qxo.com
Redirect Base qxo.com
Domain IPs 34.120.144.120
Redirect IPs 104.26.2.181, 104.26.3.181, 172.67.75.109, 2606:4700:20::681a:2b5, 2606:4700:20::681a:3b5, 2606:4700:20::ac43:4b6d
Response IP 172.67.75.109
Found Yes
Hash 1602de10058b733928780fc1d085e0bf6683e4c4c2a8493b7d3f44ce3b7d7380
SimHash d8414e4dc0d7

Groups

*

Rule Path
Disallow /my-account/*
Disallow /templates/*
Disallow /shopping-cart
Disallow /order-confirmation
Disallow /order-review
Disallow /shipping-info
Disallow /v1/*
Disallow /v2/*
Disallow /v3/*
Disallow /page/*
Disallow /images/*

Other Records

Field Value
sitemap https://www.qxo.com/sitemap/index.xml

Comments

  • we don't want indexed everything in backend
  • Our sitemap