brive-sante-bienetre.fr
robots.txt

Robots Exclusion Standard data for brive-sante-bienetre.fr

Resource Scan

Scan Details

Site Domain brive-sante-bienetre.fr
Base Domain brive-sante-bienetre.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-17T00:31:16+00:00
Next Scan 2024-12-16T00:31:16+00:00

Last Successful Scan

Scanned2023-10-31T00:05:46+00:00
URL http://www.brive-sante-bienetre.fr/robots.txt
Domain IPs 178.237.108.119
Response IP 178.237.108.119
Found Yes
Hash d24eeb71eb0da9dc6dac792f93c6f75fed193a66778ab759b54f66c654b9972a
SimHash 4b45c97ba713

Groups

*

Rule Path
Disallow /administration/
Disallow /categorie.php
Disallow /*?all=1

baiduspider
baiduspider-video
baiduspider-image
yandex
yandexbot
sogou spider
yisouspider
seokicks
ahrefsbot
mj12bot
spbot
extlinksbot
alphaseobot
alphaseobot-sa
dotbot
siteexplorer
velenpublicwebcrawler
pricebot
megaindex.ru/2.0
megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.brive-sante-bienetre.fr/sitemap.xml