Log In Sign Up

bd.com
robots.txt

Robots Exclusion Standard data for bd.com

Resource Scan

Scan Details

Site Domain bd.com
Base Domain bd.com
Scan Status Ok
Last Scan2024-09-19T17:18:00+00:00
Next Scan 2024-10-19T17:18:00+00:00

Last Scan

Scanned2024-09-19T17:18:00+00:00
URL https://www.bd.com/robots.txt
Domain IPs 23.215.7.12, 23.215.7.23
Response IP 96.17.180.45
Found Yes
Hash 50fec8334c9fbb06a20c53e45e972cc2fabf9c4d2242417aaa718730ba204cae
SimHash 6c140dd8cd27

Groups

*

Rule Path
Disallow /login
Disallow /thank-you
Disallow /*?dates=
Disallow /*?cat=
Disallow /*?productline=
Disallow /*?search=
Disallow /*?products=
Disallow /*?contenttype=
Disallow /*?resource=
Disallow /*?languages=
Disallow /*?resize=
Disallow /product-print-page*
Back to top

Other Records

Field Value
sitemap https://www.bd.com/en-us/sitemap.xml
sitemap https://www.bd.com/en-us/sitemap_products.xml
sitemap https://www.bd.com/en-ga/sitemap.xml
sitemap https://www.bd.com/fr-ca/sitemap.xml
sitemap https://www.bd.com/fr-ca/sitemap_products.xml
sitemap https://www.bd.com/en-ca/sitemap.xml
sitemap https://www.bd.com/en-ca/sitemap_products.xml
sitemap https://www.bd.com/en-in/sitemap.xml
sitemap https://www.bd.com/en-in/sitemap_products.xml
sitemap https://www.bd.com/zh-cn/sitemap.xml
sitemap https://www.bd.com/zh-cn/sitemap_products.xml
sitemap https://www.bd.com/ja-jp/sitemap.xml
sitemap https://www.bd.com/en-uk/sitemap.xml
sitemap https://www.bd.com/ja-jp/sitemap_products.xml
sitemap https://www.bd.com/en-no/sitemap.xml
sitemap https://www.bd.com/fr-fr/sitemap.xml
sitemap https://www.bd.com/en-anz/sitemap.xml
sitemap https://www.bd.com/en-anz/sitemap_products.xml
sitemap https://www.bd.com/de-ch/sitemap.xml
sitemap https://www.bd.com/de-at/sitemap.xml
sitemap https://www.bd.com/it-it/sitemap.xml
sitemap https://www.bd.com/ko-kr/sitemap.xml
sitemap https://www.bd.com/es-es/sitemap.xml
sitemap https://www.bd.com/en-sea/sitemap.xml
sitemap https://www.bd.com/nl-nl/sitemap.xml
sitemap https://www.bd.com/nl-be/sitemap.xml
sitemap https://www.bd.com/fr-be/sitemap.xml
sitemap https://www.bd.com/de-de/sitemap.xml
sitemap https://www.bd.com/ko-kr/sitemap_products.xml
sitemap https://www.bd.com/en-sea/sitemap_products.xml
sitemap https://www.bd.com/pl-pl/sitemap.xml
sitemap https://www.bd.com/en-menat/sitemap.xml
sitemap https://www.bd.com/cs-cz/sitemap.xml
sitemap https://www.bd.com/pt-latam/sitemap.xml
sitemap https://www.bd.com/en-za/sitemap.xml
sitemap https://www.bd.com/es-latam/sitemap.xml
sitemap https://www.bd.com/en-il/sitemap.xml
Back to top

Comments

  • For all bots
  • Block access for specific group of pages
  • Allow search crawlers to discover the sitemap
Back to top