huskyliners.com
robots.txt

Robots Exclusion Standard data for huskyliners.com

Resource Scan

Scan Details

Site Domain huskyliners.com
Base Domain huskyliners.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-17T21:29:20+00:00
Next Scan 2026-02-15T21:29:20+00:00

Last Successful Scan

Scanned2025-01-29T08:11:54+00:00
URL https://huskyliners.com/robots.txt
Domain IPs 3.170.229.122, 3.170.229.49, 3.170.229.56, 3.170.229.8
Response IP 3.170.229.49
Found Yes
Hash 71cce636fc74f4b4564381d8c4d6d02c746b6ea0d0bcc5f6caf00cc467fefa76
SimHash 6925d820a993

Groups

*

Rule Path
Disallow /checkout/*

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://huskyliners.com/sitemaps/sitemap.xml.gz