botanic.com
robots.txt

Robots Exclusion Standard data for botanic.com

Resource Scan

Scan Details

Site Domain botanic.com
Base Domain botanic.com
Scan Status Ok
Last Scan2024-05-21T14:56:43+00:00
Next Scan 2024-06-20T14:56:43+00:00

Last Scan

Scanned2024-05-21T14:56:43+00:00
URL https://botanic.com/robots.txt
Redirect https://www.botanic.com/robots.txt
Redirect Domain www.botanic.com
Redirect Base botanic.com
Domain IPs 34.111.218.181
Redirect IPs 34.111.218.181
Response IP 34.111.218.181
Found Yes
Hash 69d52031c67b69ca9a40e06f657a845f3515ed56505cde36d34dcd32e5e4119f
SimHash 1dc2db92cb42

Groups

*

Rule Path
Disallow /admin.php/
Disallow /rest.php/
Disallow /rest.V1.php/
Disallow /ua.php/
Disallow /uaRest.php/
Disallow /ajax.php/
Disallow /ajax.V1.php/
Disallow /widget.php/
Disallow /widgetAPI.php/
Disallow /_service.php/
Disallow /storage.php/
Disallow /index.php/
Disallow /preview.php/
Disallow /ajaxPreview.php/
Disallow /creation-de-compte.html
Disallow /se-connecter.html
Disallow /re-initialisation-du-mot-de-passe.html
Disallow /mon-compte
Disallow /erreur-interne-de-l-application.html
Disallow /page-non-trouvee.html
Disallow /autorisation-necessaire.html
Disallow /acces-refuse.html
Disallow /resultat-de-recherche-produits.html
Disallow /resultat-de-recherche-autres-contenus.html
Disallow /mon-panier.html
Disallow /passer-ma-commande.html
Disallow /confirmation-de-paiement.html
Disallow /ma-reservation.html
Disallow /c/selection/interne.html
Disallow /c/selection/interne/commande-de-produits-snacking-pour-le-siege-botanic-.html
Disallow /mes-listes-d-envies.html
Disallow /identification.html
Disallow /liste-de-diffusion.html
Disallow /*?sortBy-*=

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro

Rule Path
Disallow /

yandex
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
yandexpagechecker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.botanic.com/Assets/Rbs/Seo/sitemap-index.xml