monde-du-gecko.com
robots.txt

Robots Exclusion Standard data for monde-du-gecko.com

Resource Scan

Scan Details

Site Domain monde-du-gecko.com
Base Domain monde-du-gecko.com
Scan Status Ok
Last Scan2024-11-18T13:48:52+00:00
Next Scan 2024-11-25T13:48:52+00:00

Last Scan

Scanned2024-11-18T13:48:52+00:00
URL https://monde-du-gecko.com/robots.txt
Redirect https://www.monde-du-gecko.com/robots.txt
Redirect Domain www.monde-du-gecko.com
Redirect Base monde-du-gecko.com
Domain IPs 185.100.5.55
Redirect IPs 185.100.5.55
Response IP 185.100.5.55
Found Yes
Hash a865ee7e3ec685ba85762e4525cc4409e323a8849291cffe2b4152ca7a999aff
SimHash 6960f8cb3275

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /feed
Disallow /comments
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*.pdf$
Disallow /*?*
Disallow /*?
Disallow /wp-login.php
Allow /wp-content/uploads

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.pdf$

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

Other Records

Field Value
sitemap http://www.monde-du-gecko.com/sitemap.xml

Comments

  • On empêche l'indexation des dossiers sensibles
  • On désindexe tous les URL ayant des paramètres (duplication de contenu)
  • On désindexe la page de connexion (contenu inutile)
  • On autorise l'indexation des images
  • On empêche l'indexation des fichiers sensibles
  • Autoriser Google Image
  • Autoriser Google AdSense
  • On indique au spider le lien vers notre sitemap
  • Note : Indiquez bien le lien vers votre sitemap. Rendez-vous dans la section Sitemaps XML de WordPress SEO pour en obtenir le lien