kohlerwisconsin.com
robots.txt

Robots Exclusion Standard data for kohlerwisconsin.com

Resource Scan

Scan Details

Site Domain kohlerwisconsin.com
Base Domain kohlerwisconsin.com
Scan Status Ok
Last Scan2024-09-22T23:38:00+00:00
Next Scan 2024-10-22T23:38:00+00:00

Last Scan

Scanned2024-09-22T23:38:00+00:00
URL https://www.kohlerwisconsin.com/robots.txt
Domain IPs 184.50.85.155, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:71b, 96.17.180.3
Response IP 96.17.180.51
Found Yes
Hash d3781d1cfa2fcc10dafff26e555f3d7667d65dccb93ab3919d29e93a8e23d7e2
SimHash 491e9e33659b

Groups

yandexbot
semrushbot
dotbot
atomz/1.0
facebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

baiduspider
bingbot
slurp
duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kohlerwisconsin.com/content/kohler-destinations/us/en.sitemap.xml

Warnings

  • `host` is not a known field.