Log In Sign Up

jaime-jardiner.ouest-france.fr
robots.txt

Robots Exclusion Standard data for jaime-jardiner.ouest-france.fr

Resource Scan

Scan Details

Site Domain jaime-jardiner.ouest-france.fr
Base Domain ouest-france.fr
Scan Status Ok
Last Scan2024-05-02T00:48:23+00:00
Next Scan 2024-06-01T00:48:23+00:00

Last Scan

Scanned2024-05-02T00:48:23+00:00
URL https://jaime-jardiner.ouest-france.fr/robots.txt
Domain IPs 164.132.235.17
Response IP 164.132.235.17
Found Yes
Hash ee689d6362531a38ffa84bc77dd3c4e0726784d2c969b08c936e6b069b061ee5
SimHash 23511f80027d

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /category/*/*
Disallow */trackback
Disallow */comments
Disallow /wp-json
Disallow /boutique/cgi-bin
Disallow /boutique/wp-login.php
Disallow /boutique/wp-admin
Disallow /boutique/wp-includes
Disallow /boutique/wp-content/plugins
Disallow /boutique/wp-content/cache
Disallow /boutique/wp-content/themes
Disallow /boutique/*/trackback
Disallow /boutique/*/comments
Disallow /boutique/*?orderby=price
Disallow /boutique/*?orderby=rating
Disallow /boutique/*?orderby=date
Disallow /boutique/*?filter
Disallow /boutique/categorie-produit/*/*/*/?add-to-cart=*
Disallow /boutique/categorie-produit/*/*/?add-to-cart=*
Disallow /boutique/etiquette-produit/*/?add-to-cart=*
Disallow */feed

googlebot

Rule Path
Disallow /*.php$
Allow /*.js$
Disallow /*.inc$
Allow /*.css$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

googlebot-image

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap https://jaime-jardiner.ouest-france.fr/sitemap_index.xml
sitemap https://jaime-jardiner.ouest-france.fr/boutique/sitemap.xml
Back to top

Comments

  • On empeche l'indexation des dossiers sensibles
  • éléments pour la boutique
  • Demande de non-indexation d’url de la boutique qui duplique les urls
  • Disallow: */feed >> Sur instruction de Greg ;-)
  • On empeche l'indexation des fichiers sensibles Mais on donne acces aux fichiers CSS et JS
  • Autoriser Google Image
  • On indique au spider le lien vers notre sitemap
Back to top