sterling.kohler.com
robots.txt

Robots Exclusion Standard data for sterling.kohler.com

Resource Scan

Scan Details

Site Domain sterling.kohler.com
Base Domain kohler.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-06-10T03:21:37+00:00
Next Scan 2024-09-08T03:21:37+00:00

Last Successful Scan

Scanned2023-10-21T03:18:34+00:00
URL https://sterling.kohler.com/robots.txt
Domain IPs 23.52.171.241, 23.59.168.176, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:71b
Response IP 23.59.168.176
Found Yes
Hash 80be2c2e5a592e86d2fce60ec9054da19712e85653f33eb06492030961e6c47c
SimHash a9151231e99b

Groups

yandexbot
semrushbot
dotbot
*

Rule Path
Disallow /en/member/insider-program-associate-discount
Disallow /en/cart
Disallow /en/checkout
Disallow /en/orders/order-confirmation
Disallow /en/orders/order-history
Disallow /en/orders/order-details
Disallow /en/orders/order-status
Disallow /en/modules

baiduspider
bingbot
slurp
duckduckbot
ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sterling.kohler.com/en/sitemap.xml