Log In Sign Up

sigurd.fr
robots.txt

Robots Exclusion Standard data for sigurd.fr

Resource Scan

Scan Details

Site Domain sigurd.fr
Base Domain sigurd.fr
Scan Status Ok
Last Scan2025-09-20T19:24:32+00:00
Next Scan 2025-09-27T19:24:32+00:00

Last Scan

Scanned2025-09-20T19:24:32+00:00
URL https://sigurd.fr/robots.txt
Domain IPs 109.234.164.47
Response IP 109.234.164.47
Found Yes
Hash 509df328ae57642520b71cab077dec58496301a985fff7d18f22263d88b361f6
SimHash 6941d8c37216

Groups

*

Rule Path
Disallow /secupress-afc5a08a/
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Disallow /feed
Disallow /comments
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*.pdf$
Disallow /wp-login.php
Disallow /vanette

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*?*
Disallow /*?
Allow /wp-content/uploads

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.pdf$

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /feed/
Disallow */feed
Disallow */feed$
Disallow /feed/$
Disallow /comments/feed
Disallow /?feed=
Disallow /wp-feed

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

*

Rule Path
Disallow /*add-to-cart%3D*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Back to top

Other Records

Field Value
sitemap https://sigurd.fr/sitemaps.xml
sitemap https://sigurd.fr/sitemaps.xml
Back to top

Comments

  • On empêche l'indexation des dossiers sensibles
  • On désindexe la page de connexion (contenu inutile SecuPress Pro)
  • Règles de WP par Défaut
  • On désindexe tous les URL ayant des paramètres (duplication de contenu)
  • On autorise l'indexation des images
  • On empêche l'indexation des fichiers sensibles
  • Autoriser Google Image
  • Autoriser Google AdSense
  • On indique au spider le lien vers notre sitemap
  • Bloquer le Robot MAJESTICSEOBOT
  • Bloquer AHREFSBOT
  • Bloquer SEMRUSHBOT
  • Bloquer Robot CLAUDE
  • Bloquer le Flux RSS
  • Bloquer les Résultats de Recherche
  • Bloquer Paniers(Woocommerce)
  • Bloquer Robot CHATGPT
  • Bloquer Robot BARD
  • Bloquer le Robot PETAL
  • Bloquer le Robot MAJESTISEOROBOT
  • Bloquer AHREFSBOT
  • Régles par défaut de WooCommerce
  • Link to your sitemap
Back to top