avis-deces.midilibre.fr
robots.txt

Robots Exclusion Standard data for avis-deces.midilibre.fr

Resource Scan

Scan Details

Site Domain avis-deces.midilibre.fr
Base Domain midilibre.fr
Scan Status Ok
Last Scan2025-03-03T08:37:40+00:00
Next Scan 2025-04-02T08:37:40+00:00

Last Scan

Scanned2025-03-03T08:37:40+00:00
URL https://avis-deces.midilibre.fr/robots.txt
Domain IPs 212.95.67.26
Response IP 212.95.67.26
Found Yes
Hash 19b868e683e50aa7511e2475f7953b58294918ee374b8fe08ba1524917be02c8
SimHash f1ca411180d7

Groups

*

Rule Path
Disallow /avis/recherche
Disallow /professionnels/recherche
Disallow /partenaires/recherche
Disallow /redirect
Disallow /connect/profile
Disallow /api
Disallow /bundles

admantx

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://avis-deces.midilibre.fr/sitemap.xml