Log In Sign Up

macity-occitanie.com
robots.txt

Robots Exclusion Standard data for macity-occitanie.com

Resource Scan

Scan Details

Site Domain macity-occitanie.com
Base Domain macity-occitanie.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-18T19:58:10+00:00
Next Scan 2025-12-17T19:58:10+00:00

Last Successful Scan

Scanned2025-05-22T06:13:27+00:00
URL https://macity-occitanie.com/robots.txt
Domain IPs 109.234.160.151
Response IP 109.234.160.151
Found Yes
Hash b4d98cd28259b973e360935673c248416d824fc584d016b647580383ce0d3272
SimHash 096172c2024f

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /comments
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?*
Disallow /*?

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

googlebot-image

Rule Path
Allow /wp-content/uploads/*

google-speakr

Rule Path
Allow /*

google-read-aloud

Rule Path
Allow /*

mediapartners-google

Rule Path
Allow /*

bingbot

Rule Path
Allow /*

yahoo! slurp

Rule Path
Allow /*

teoma

Rule Path
Allow /*

baiduspider

Rule Path
Allow /*

yandex

Rule Path
Allow /*

applebot

Rule Path
Allow /*

exabot

Rule Path
Allow /*

ia_archiver

Rule Path
Allow /*

qwantify

Rule Path
Allow /*

wikiwix

Rule Path
Allow /*

duckduckbot

Rule Path
Allow /*
Back to top

Other Records

Field Value
sitemap https://www.macity-occitanie.com/sitemap_index.xml
Back to top

Comments

  • On empeche l'indexation des dossiers sensibles
  • On empeche l'indexation des fichiers sensibles
  • Autoriser Google Image
  • Autoriser Google Recherche vocale (?)
  • Autoriser Google Recherche contenu (?)
  • Autoriser Google mediapartner
  • Autoriser Bing
  • Autoriser Yahoo
  • Autoriser Ask
  • Autoriser Baidu
  • Autoriser Yandex
  • Autoriser Apple, Siri
  • Autoriser Exalead
  • Autoriser Alexa
  • Autoriser Qwant
  • Autoriser MAJ Wikipedia
  • Autoriser Duck duck go
  • On indique au spider le lien vers notre sitemap
Back to top