avis-deces.ladepeche.fr
robots.txt

Robots Exclusion Standard data for avis-deces.ladepeche.fr

Resource Scan

Scan Details

Site Domain avis-deces.ladepeche.fr
Base Domain ladepeche.fr
Scan Status Ok
Last Scan2025-03-03T08:39:07+00:00
Next Scan 2025-04-02T08:39:07+00:00

Last Scan

Scanned2025-03-03T08:39:07+00:00
URL https://avis-deces.ladepeche.fr/robots.txt
Domain IPs 212.95.67.26
Response IP 212.95.67.26
Found Yes
Hash 615f906bfec4dd419d62d46b70d1010a557140eedc70a2284e1892eeae5382e3
SimHash f1ca411180d7

Groups

*

Rule Path
Disallow /avis/recherche
Disallow /professionnels/recherche
Disallow /partenaires/recherche
Disallow /redirect
Disallow /connect/profile
Disallow /api
Disallow /bundles

admantx

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://avis-deces.ladepeche.fr/sitemap.xml