luxebotanics.com
robots.txt

Robots Exclusion Standard data for luxebotanics.com

Resource Scan

Scan Details

Site Domain luxebotanics.com
Base Domain luxebotanics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan6/6/2025, 8:12:22 PM
Next Scan 6/20/2025, 8:12:22 PM

Last Successful Scan

Scanned5/15/2025, 8:08:01 PM
URL https://luxebotanics.com/robots.txt
Domain IPs 104.21.39.245, 172.67.172.44, 2606:4700:3033::ac43:ac2c, 2606:4700:3037::6815:27f5
Response IP 104.21.39.245
Found Yes
Hash 1a081585115784f79daa1cdf6ca0e211f057da68bff673e13782e04b7a129940
SimHash 4a1dd854a783

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

yandex

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://luxebotanics.com/sitemap.xml