firesidecellars.com
robots.txt

Robots Exclusion Standard data for firesidecellars.com

Resource Scan

Scan Details

Site Domain firesidecellars.com
Base Domain firesidecellars.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-27T18:44:25+00:00
Next Scan 2025-10-25T18:44:25+00:00

Last Successful Scan

Scanned2024-06-09T21:29:48+00:00
URL https://firesidecellars.com/robots.txt
Domain IPs 13.226.210.118, 13.226.210.66, 13.226.210.70, 13.226.210.84
Response IP 3.160.246.100
Found Yes
Hash e1ab4d9d3c76265cad37a03402b2d42f0df6d9fbd8653148a59b394c436b9c45
SimHash 591cce7ace31

Groups

blexbot
seznambot
ccbot
spbot
screaming
semrushbot
mj12bot
baiduspider
yandex
mauibot
linguee

Rule Path
Disallow /

dotbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /index.php/dashboard
Disallow /lib/ClickTale/
Disallow /catalogsearch
Disallow /api/
Disallow /checkout/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Allow /customer/account/login/
Allow /index.php$
Allow /index.php?

Other Records

Field Value
sitemap https://firesidecellars.com/sitemap_index.xml