b2b.alveus.eu
robots.txt

Robots Exclusion Standard data for b2b.alveus.eu

Resource Scan

Scan Details

Site Domain b2b.alveus.eu
Base Domain alveus.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T16:17:25+00:00
Next Scan 2026-01-13T16:17:25+00:00

Last Successful Scan

Scanned2025-08-23T19:55:44+00:00
URL https://b2b.alveus.eu/robots.txt
Domain IPs 18.192.232.103, 2a05:d014:660:1200:7914:46d2:72d6:be89, 2a05:d014:660:1201:7b8:4f77:6902:1433, 2a05:d014:660:1203:7aa7:2e9e:9712:1136, 3.64.49.226, 3.75.80.108
Response IP 3.75.80.108
Found Yes
Hash fe7c4dfe3eb129cc8beca90bb905363828567387cf68ce82104d484e82410806
SimHash 61123842b421

Groups

*

Rule Path
Disallow */imprint
Disallow */terms-and-conditions
Disallow */privacy-policy
Disallow */cookie-policy
Disallow /es/aviso-legal
Disallow /es/condiciones-generales
Disallow /es/politica-de-privacidad
Disallow /de/impressum
Disallow /de/avb
Disallow /de/datenschutz
Disallow /fr/mentions-legales
Disallow /fr/terms-and-conditions
Disallow /fr/politique-de-confidentialite
Disallow /it/informazioni-aziendali
Disallow /it/condizioni-generali
Disallow /it/informativa-sulla-privacy
Disallow */cookies*
Disallow *?cat=*
Disallow *?nxt_*
Allow *.html?nxt_ingredients_filter=501
Allow *.html?nxt_organic_natural_filter=749
Allow *.html?nxt_flavoured_filter=746
Allow *.html?nxt_monoblend=936
Disallow */customer/*
Disallow */wishlist/*
Disallow */sales/order/history/*
Disallow */catalog/product_compare/index/*
Disallow */checkout/*
Disallow */orderbysku/*
Disallow */thankyou*
Disallow /config/
Disallow /phpinfo.php
Disallow /cache.php
Disallow /namespace.yaml
Disallow /security.config.php
Disallow /frontend_dev.php

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

cookiebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://b2b.alveus.eu/sitemap.xml
sitemap https://b2b.alveus.eu/sitemap_ES.xml
sitemap https://b2b.alveus.eu/sitemap_DE.xml
sitemap https://b2b.alveus.eu/sitemap_FR.xml
sitemap https://b2b.alveus.eu/sitemap_IT.xml

Comments

  • SITEMAPS
  • CORPORATIVE PAGES
  • FILTERS
  • PRIVATE URLS
  • TECHNICAL RESOURCES
  • SPECIFIC BOTS

Warnings

  • 1 invalid line.