Log In Sign Up

flowersbybernard.com
robots.txt

Robots Exclusion Standard data for flowersbybernard.com

Resource Scan

Scan Details

Site Domain flowersbybernard.com
Base Domain flowersbybernard.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-03T17:07:08+00:00
Next Scan 2024-07-03T17:07:08+00:00

Last Successful Scan

Scanned2024-04-12T13:13:15+00:00
URL https://flowersbybernard.com/robots.txt
Domain IPs 18.154.206.114, 18.154.206.53, 18.154.206.66, 18.154.206.92
Response IP 18.165.171.17
Found Yes
Hash 65cff81d3540c57c2c81014f5f1516bc9a384641ff3ea7c34e832b650a94ee2e
SimHash cc3dd012cc71

Groups

blexbot
seznambot
ccbot
spbot
semrushbot
mj12bot
baiduspider
yandex
mauibot
linguee

Rule Path
Disallow /

*

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /checkout/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Disallow /*?

storebot-google

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Disallow /*?
Back to top

Other Records

Field Value
sitemap https://flowersbybernard.com/sitemap_index.xml
Back to top

Comments

  • Disallow SalesForce Marketing Cloud links that appear to escape URLs
  • Disallow platform-specific URLs that come across as a query string,
  • but allow pagination (`?p=[d]`)
Back to top