Log In Sign Up

connect.maif.fr
robots.txt

Robots Exclusion Standard data for connect.maif.fr

Resource Scan

Scan Details

Site Domain connect.maif.fr
Base Domain maif.fr
Scan Status Ok
Last Scan2024-11-03T08:44:45+00:00
Next Scan 2024-12-03T08:44:45+00:00

Last Scan

Scanned2024-11-03T08:44:45+00:00
URL https://connect.maif.fr/robots.txt
Redirect https://www.maif.fr/robots.txt
Redirect Domain www.maif.fr
Redirect Base maif.fr
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 3ebe5235bf1c09ac39f483403d25ac310982d794a8e3bffec6cc0704646d05e2
SimHash 052adf1ad3d9

Groups

swebot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

bender

Rule Path
Disallow /

discobot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

searchwebengine.net

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

findfiles.net

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

goodzer

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

fast enterprise crawler 6

Rule Path
Disallow /

sensis.com.au web crawler

Rule Path
Disallow /

worio bot heritrix

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

*

Rule Path
Disallow */1000
Disallow *JSON-RPC
Disallow *?genesysCritere=*
Disallow *?_=*
Disallow /recherche/*
Disallow /*jsessionid*
Disallow *?type=js&session*
Disallow *?xtor=*
Disallow *?redirection=false*
Disallow *?xtatc=*
Disallow *?xtmc=*
Disallow *?xts=*
Disallow *?p=*
Disallow *?itemDesc*
Disallow *?action=*
Disallow *?genesysCodeBouton*
Disallow *utm_source*
Disallow *?paf*
Disallow *?reset=*
Disallow *?themeid=*
Disallow *?ver=*
Disallow *?idPartenaire=*
Disallow *?urlPage=*
Disallow *?codeTypeProduit=*
Disallow *%*
Disallow *4plus2*
Disallow *?msclkid=*
Disallow *?gclsrc=*
Disallow *?_wrapper*
Disallow *?ds_rl=*
Disallow *?_sm_byp=*
Disallow *hstc%3D*
Disallow */ProduitBlancServlet?adresse=*
Disallow *?swp_debug=*
Disallow */webcallgenesys/*
Disallow /erreurs/*
Disallow /key/*
Disallow /alfresco/*
Disallow *?inscription=*
Disallow *?nomInfo=*
Disallow *?adresse=*
Disallow *?adrUrl*
Disallow *?ciamReturnUrl*
Disallow /?*
Disallow */ProduitBlancServlet?*
Disallow *?utm_source*
Disallow *?fbclid*
Disallow *?thematic*
Disallow */accueil.html?*
Disallow *?_cldee*
Disallow *?gclid=*
Disallow *?vm=*
Disallow *?conclusion=*
Disallow *?infographic=*
Disallow */gateway/*
Disallow *?red*
Disallow *?view&xtatc=*
Disallow *?view=PM*
Disallow *xtor%3D*
Disallow /*?xtor=
Disallow /*xtor*
Disallow /*?*xtor=*
Allow /services-en-ligne/assurance-habitation/devis/
Allow /services-en-ligne/devis/vam/dv_pour_bien_demarrer.action?view
Allow /services-en-ligne/devis/vam/dv_pour_bien_demarrer.action
Allow /services-en-ligne/nous-ecrire/
Disallow /services-en-ligne/*
Disallow /files/live/sites/maif-fr/files/txt/tags.html
Disallow /annexes/tarifs
Disallow /accueil.html
Disallow /erreurCookies.html
Disallow /annexes/mentions-legales/gestion-cookies
Disallow /annexes/mentions-legales
Disallow /annexes/mentions-legales/mentions-protection-juridique
Disallow /particuliers/services-au-quotidien/protection-juridique/fiches/identification.action
Disallow /portal/*
Disallow /recrutement/*
Disallow /site2/*
Disallow /site1/*
Disallow /app-ads.txt
Disallow /ads.txt
Disallow /security.txt
Disallow /accueil.action
Disallow /Assurance/Habitation
Disallow /salondeleducation
Disallow /assistantvisites
Disallow /service/identification/dmdrestitutioncodeconfidentiel.action
Disallow /auto-responsable.html
Disallow */browserconfig.xml
Disallow /particuliers/habitation/assurance-emprunteur/ajouterEmprunteur.html?view
Disallow /particuliers/sante-prevoyance/assurance-obseque/confirmCalculCotisationSollicitude.action?view=input
Disallow /particuliers/sante-prevoyance/assurance-obseque/devisCotisationSollicitude.action?view
Disallow /modules/CsrfServlet
Back to top

Other Records

Field Value
sitemap https://www.maif.fr/sitemap.xml
Back to top

Comments

  • bot changes to block bad bots 2-8-2012 JB
  • added by SD on 12/30/04 bot causing a lot of CF errors to occur
  • empeche le crawl des pdf
  • empeche le crawl des urls avec parametres
  • autres urls et dossiers bloques volontairement
Back to top

Warnings

  • 1 invalid line.
Back to top