Log In Sign Up

prixdesmetaux.fr
robots.txt

Robots Exclusion Standard data for prixdesmetaux.fr

Resource Scan

Scan Details

Site Domain prixdesmetaux.fr
Base Domain prixdesmetaux.fr
Scan Status Ok
Last Scan2024-09-29T05:22:00+00:00
Next Scan 2024-10-06T05:22:00+00:00

Last Scan

Scanned2024-09-29T05:22:00+00:00
URL https://prixdesmetaux.fr/robots.txt
Domain IPs 78.40.11.138
Response IP 78.40.11.138
Found Yes
Hash 033c5e232cf0d3b86044a0d7e1638e98d902b9e18a9f6cdba436aa222173d993
SimHash 4b4119901256

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?

googlebot

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap http://www.prixdesmetaux.fr/sitemap.xml
Back to top

Comments

  • On empeche l'indexation des dossiers sensibles
  • On empeche l'indexation des fichiers sensibles
  • Autoriser Google Image
  • Autoriser Google AdSense
  • On indique au spider le lien vers le sitemap
Back to top