levismulhouse.com
robots.txt

Robots Exclusion Standard data for levismulhouse.com

Resource Scan

Scan Details

Site Domain levismulhouse.com
Base Domain levismulhouse.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-21T12:51:59+00:00
Next Scan 2024-12-20T12:51:59+00:00

Last Successful Scan

Scanned2023-05-03T22:05:58+00:00
URL http://www.levismulhouse.com/robots.txt
Domain IPs 178.237.108.119
Response IP 178.237.108.119
Found Yes
Hash bf1f5b1fb9ee5bced339715d5736314491697329d2cd7ab432476236c37770b4
SimHash 0345c97ba713

Groups

*

Rule Path
Disallow /administration/
Disallow /categorie.php
Disallow /*?all=1

baiduspider
baiduspider-video
baiduspider-image
yandex
yandexbot
sogou spider
yisouspider
seokicks
ahrefsbot
mj12bot
spbot
extlinksbot
alphaseobot
alphaseobot-sa
dotbot
siteexplorer
velenpublicwebcrawler
pricebot
megaindex.ru/2.0
megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.levismulhouse.com/sitemap.xml