frayssetraiteur19.fr
robots.txt

Robots Exclusion Standard data for frayssetraiteur19.fr

Resource Scan

Scan Details

Site Domain frayssetraiteur19.fr
Base Domain frayssetraiteur19.fr
Scan Status Ok
Last Scan2024-10-25T15:21:16+00:00
Next Scan 2024-11-24T15:21:16+00:00

Last Scan

Scanned2024-10-25T15:21:16+00:00
URL http://www.frayssetraiteur19.fr/robots.txt
Domain IPs 178.237.108.119
Response IP 178.237.108.119
Found Yes
Hash 53fb6739ee765546786c1a3faca5f9b48acaa978bd3c8c7c8dbdde02d73fc709
SimHash 4744c9fba712

Groups

*

Rule Path
Disallow /administration/
Disallow /categorie.php
Disallow /poserQuestion.php
Disallow /panier.php
Disallow /contact.php
Disallow /*?all=1

baiduspider
baiduspider-video
baiduspider-image
yandex
yandexbot
sogou spider
yisouspider
seokicks
ahrefsbot
mj12bot
spbot
extlinksbot
alphaseobot
alphaseobot-sa
dotbot
siteexplorer
velenpublicwebcrawler
pricebot
megaindex.ru/2.0
megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.frayssetraiteur19.fr/sitemap.xml