andesflorist.com
robots.txt

Robots Exclusion Standard data for andesflorist.com

Resource Scan

Scan Details

Site Domain andesflorist.com
Base Domain andesflorist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-28T14:26:31+00:00
Next Scan 2024-06-11T14:26:31+00:00

Last Successful Scan

Scanned2024-04-20T11:03:11+00:00
URL https://andesflorist.com/robots.txt
Domain IPs 108.138.246.110, 108.138.246.21, 108.138.246.33, 108.138.246.42
Response IP 18.165.171.38
Found Yes
Hash 11f088688c6a328b01b4d43a72601097cbb76edf26240bab83e68cb25ffb7332
SimHash cc3cd012ce31

Groups

blexbot
seznambot
ccbot
spbot
semrushbot
mj12bot
baiduspider
yandex
mauibot
linguee

Rule Path
Disallow /

*

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /checkout/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Disallow /*?

storebot-google

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Disallow /*?

Other Records

Field Value
sitemap https://andesflorist.com/sitemap_index.xml

Comments

  • Disallow SalesForce Marketing Cloud links that appear to escape URLs
  • Disallow platform-specific URLs that come across as a query string,
  • but allow pagination (`?p=[d]`)