Log In Sign Up

rugbyamateur.fr
robots.txt

Robots Exclusion Standard data for rugbyamateur.fr

Resource Scan

Scan Details

Site Domain rugbyamateur.fr
Base Domain rugbyamateur.fr
Scan Status Ok
Last Scan2024-09-17T06:23:38+00:00
Next Scan 2024-09-24T06:23:38+00:00

Last Scan

Scanned2024-09-17T06:23:38+00:00
URL https://rugbyamateur.fr/robots.txt
Domain IPs 104.26.10.191, 104.26.11.191, 172.67.75.252, 2606:4700:20::681a:abf, 2606:4700:20::681a:bbf, 2606:4700:20::ac43:4bfc
Response IP 172.67.75.252
Found Yes
Hash 145e9fabffbb58fc12306f0fd85e7f066ee3bae9173078df7a71680a7e8f1690
SimHash 434118811257

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?

googlebot

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

googlebot-image

Rule Path
Disallow /wp-content/uploads/2017/10/romain-groc-talon-roquettes.jpg
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap http://www.rugbyamateur.fr/sitemap.xml
Back to top

Comments

  • On empêche l'indexation des dossiers sensibles
  • On empêche l'indexation des fichiers sensibles
  • Autoriser Google Image
  • Autoriser Google AdSense
  • On indique au spider le lien vers notre sitemap
Back to top