campingdeschevrets.fr
robots.txt

Robots Exclusion Standard data for campingdeschevrets.fr

Resource Scan

Scan Details

Site Domain campingdeschevrets.fr
Base Domain campingdeschevrets.fr
Scan Status Ok
Last Scan2024-09-11T23:56:18+00:00
Next Scan 2024-10-11T23:56:18+00:00

Last Scan

Scanned2024-09-11T23:56:18+00:00
URL https://campingdeschevrets.fr/robots.txt
Redirect https://www.campingdeschevrets.fr/robots.txt
Redirect Domain www.campingdeschevrets.fr
Redirect Base campingdeschevrets.fr
Domain IPs 78.40.10.137
Redirect IPs 78.40.10.137
Response IP 78.40.10.137
Found Yes
Hash 40335a5a4843fad1cd0df82745c3135f0fec648af4b365e1c0e5cf0920a7ae1b
SimHash 11f57d52e639

Groups

ahrefsbot
baiduspider
barkrowler
blexbot
bubing
catchbot
cfnetwork
cliqzbot
coccocbot-web
companybook-crawler
curious george
curious george - www.analyticsseo.com
curious george - www.analyticsseo.com/crawler
digincore
domaincrawler
domaincrawler/3.0
dotbot
duppies
exalead
exaleadcloudview
exensa-dew
faviconizer
garlik
garlikcrawler
grapeshot
iccrawler - icjobs
java/1.6.0_04
linkdexbot
linkdexbot/2.0
linkdexbot/2.2
linkpadbot
ltx71 - (http://ltx71.com/)
mail.ru
megaindex
megaindex.ru
melodibot
mj12bot
netestate ne crawler
netestate ne crawler (+http://www.website-datenbank.de/)
obot
panscient.com
proximic
python-urllib
r6_feedfetcher
r6_commentreader
root/0.1
scoutjet
seoscanners.net
seoscanners.net/1
semrushbot
semrushbot-sa
seznambot
sistrix
smtbot
sogou spider
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
spbot
spinn3r
synthesio
titan
turnitinbot
turnitinbot
twengabot-2.0
ucrawler/1.0
ucrawler
uptimebot
wotbox
yandex
yisouspider
zoombot
zoominfobot

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.campingdeschevrets.fr/sitemaps.xml

Comments

  • robots interdits