Log In Sign Up

fnet.fr
robots.txt

Robots Exclusion Standard data for fnet.fr

Resource Scan

Scan Details

Site Domain fnet.fr
Base Domain fnet.fr
Scan Status Ok
Last Scan2025-09-03T19:29:16+00:00
Next Scan 2025-10-03T19:29:16+00:00

Last Scan

Scanned2025-09-03T19:29:16+00:00
URL https://fnet.fr/robots.txt
Redirect https://www.capitainecomment.fr/robots.txt
Redirect Domain www.capitainecomment.fr
Redirect Base capitainecomment.fr
Domain IPs 2001:41d0:301::29, 51.91.236.255
Redirect IPs 2001:41d0:301::29, 51.91.236.255
Response IP 51.91.236.255
Found Yes
Hash a5af1bc18ba8d51cff2030c268e085dfae81334425af1a56710a23177e31c43c
SimHash 6b0499846233

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow */trackback
Disallow /*/comments
Disallow /*/feed/
Disallow /*/feed/rss/
Disallow /*/*respond$
Disallow /?filter_by=*
Disallow /?s=*
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow
Allow /wp-includes/*
Allow /wp-content/*
Allow /wp-content/themes/*
Allow /wp-content/plugins/*
Allow /wp-content/uploads/*
Allow /wp-content/cache/*
Allow /*.js$
Allow /*.css$
Allow */css/*
Allow */js/*
Allow /wp-content*.css*
Allow /wp-content*.js*
Allow /wp-includes*.css*
Allow /wp-includes*.js*
Back to top

Other Records

Field Value
sitemap https://www.capitainecomment.fr/sitemap_index.xml
Back to top

Comments

  • On empeche l'indexation du DC et Rss
  • On empeche l'indexation des recherches et facettes
  • On empeche l'indexation des dossiers sensibles
  • On autorise Google Image
  • On autorise Google Adsense
  • On autorise les dossiers et fichiers qui bloquent
  • Lien des sitemaps
Back to top