bhs.com
robots.txt

Robots Exclusion Standard data for bhs.com

Resource Scan

Scan Details

Site Domain bhs.com
Base Domain bhs.com
Scan Status Ok
Last Scan2024-10-21T21:30:37+00:00
Next Scan 2024-11-20T21:30:37+00:00

Last Scan

Scanned2024-10-21T21:30:37+00:00
URL https://bhs.com/robots.txt
Redirect https://www.bhs.com/robots.txt
Redirect Domain www.bhs.com
Redirect Base bhs.com
Domain IPs 104.26.2.165, 104.26.3.165, 172.67.68.93, 2606:4700:20::681a:2a5, 2606:4700:20::681a:3a5, 2606:4700:20::ac43:445d
Redirect IPs 104.26.2.165, 104.26.3.165, 172.67.68.93, 2606:4700:20::681a:2a5, 2606:4700:20::681a:3a5, 2606:4700:20::ac43:445d
Response IP 172.67.68.93
Found Yes
Hash 9fcca32bca16202f134adecbb169541ffc4f4e4d565e5875660fa16bb63d9939
SimHash 6f14dcd7c816

Groups

*

Rule Path
Disallow *sid%3D
Disallow *SID%3D

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

codewisebot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /
Disallow /*?
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /admin/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /faq/
Disallow /enable-cookies/
Disallow /terms/
Disallow /privacy-policy/
Disallow /terms-of-sale/
Disallow /return/
Disallow /delivery/
Disallow /security/
Disallow /press/
Disallow /about/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/

Other Records

Field Value
sitemap https://www.bhs.com/sitemap.xml

Warnings

  • `host` is not a known field.