meilleursagents.com
robots.txt

Robots Exclusion Standard data for meilleursagents.com

Resource Scan

Scan Details

Site Domain meilleursagents.com
Base Domain meilleursagents.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T10:42:52+00:00
Next Scan 2024-11-15T10:42:52+00:00

Last Successful Scan

Scanned2022-11-02T20:28:06+00:00
URL https://meilleursagents.com/robots.txt
Redirect https://www.meilleursagents.com:443/robots.txt
Redirect Domain www.meilleursagents.com
Redirect Base meilleursagents.com
Response IP 130.211.12.205
Found Yes
Hash 9806812bc80221041984773ec19ccbb48ba825fb98af767dabc39dcb2dd15ab8
SimHash 003d56cac3a0

Groups

*

Rule Path
Disallow /prix-immobilier/agences/
Disallow /property
Disallow /mon-compte/
Disallow /renew_password
Disallow /request_password
Disallow /connect/
Disallow /photos/
Disallow /autologin
Disallow /user/
Disallow /lang/
Disallow /my/
Disallow /agence-immobiliere/*/contact
Disallow /agence-immobiliere/*/*/
Allow /agence-immobiliere/agence-*
Disallow /mandataire-immobilier/*/
Allow /mandataire-immobilier/mandataire-*
Disallow /agence-immobiliere/agence-*/avis-clients/brouillon
Disallow /mandataire-immobilier/mandataire-*/avis-clients/brouillon
Disallow /professionnel-immobilier/*/*/
Disallow /activity/
Disallow /robots/
Disallow /captcha/
Disallow /v/
Disallow /email_friend*
Disallow /*/feedback*
Disallow /immobilier/recherche/*
Disallow /*form?action*
Disallow /_signin*
Disallow /*?hidden=1
Disallow /prix-immobilier/map-info*
Disallow /my/realtor/*
Disallow /message-bien-vendu-*
Disallow /immobilier/recherche/*
Disallow /*?sort=*
Disallow /activity/trial*
Disallow /campaign/link*
Disallow /carte/
Disallow /api/
Disallow /signaler/
Disallow /*comment-page-*/
Disallow /*feed/
Disallow /*trackback/
Disallow /*?replytocom=*
Disallow /actualite-immobilier/?p=*
Disallow /contact_realtor*
Disallow /*/liste-references/*
Disallow /*/liste-avis-clients/
Disallow /immobilier/faisabilite/*
Disallow /*/feedback*
Disallow *?order*
Disallow /email_friend*
Disallow /*/follow*
Disallow /*/hide*
Disallow /*/realtor_phone*
Disallow /*/show*
Disallow /*/unfollow*
Disallow *?from=

ahrefsbot
archive.org_bot
atraxsolutions
camontspider
discobot
dotbot
exabot
gaisbot
heritrix
ia_archiver
mj12bot
nutch
panscient.com
psbot
sapphirewebcrawler
scoutjet
twiceler
yandex
yandexsomething
ccbot
trendictionbot
cliqzbot

Rule Path
Disallow /