Log In Sign Up

snfcp.org
robots.txt

Robots Exclusion Standard data for snfcp.org

Resource Scan

Scan Details

Site Domain snfcp.org
Base Domain snfcp.org
Scan Status Ok
Last Scan2025-10-08T17:13:04+00:00
Next Scan 2025-10-15T17:13:04+00:00

Last Scan

Scanned2025-10-08T17:13:04+00:00
URL https://snfcp.org/robots.txt
Domain IPs 104.21.86.130, 172.67.220.48, 2606:4700:3032::6815:5682, 2606:4700:3035::ac43:dc30
Response IP 104.21.86.130
Found Yes
Hash aa02013a40550237451e5dd6ac5f22ba66995b7799539b2a2040e6ac043a35b5
SimHash 474802824f33

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-content/uploads/documents
Disallow /wp-content/uploads/bewpi-invoices
Disallow /wp-content/uploads/bewpi-templates
Disallow /wp-content/uploads/woocommerce-pdf-invoices
Disallow /wp-content/uploads/woocommerce_uploads
Disallow /wp-content/uploads/woocommerce-certificate-attendance/
Disallow /cgi-bin
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.cgi$
Disallow */trackback
Disallow /*/feed
Disallow /*/comments
Disallow /readme.html
Disallow /readme.md
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.snfcp.org/sitemap_index.xml
Back to top

Comments

  • http://creer-un-site.com/optimiser-fichier-robots-txt-wordpress/
  • Anamorphik
  • Ne pas indexer dossier general WP
  • Ne pas indexer ce rĂ©pertoire qui est sensible
  • Ne pas indexer les fichiers sensibles
  • Ne pas indexer les URL de trackback et de ping
  • Ne pas indexer les flux RSS sauf le principal
  • Ne pas indexer les URL de commentaire
  • Ne pas indexer les fichiers suivants
  • Autorisation
  • Sitemap
Back to top