Log In Sign Up

festival-beauregard.com
robots.txt

Robots Exclusion Standard data for festival-beauregard.com

Resource Scan

Scan Details

Site Domain festival-beauregard.com
Base Domain festival-beauregard.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-04T18:43:45+00:00
Next Scan 2024-10-11T18:43:45+00:00

Last Successful Scan

Scanned2024-09-26T18:20:57+00:00
URL https://festival-beauregard.com/robots.txt
Domain IPs 109.234.165.68
Response IP 109.234.165.68
Found Yes
Hash 98c2356165951b59784b831b62f5ba6a2b632bab333c0ea8d34ebe1aa32f3199
SimHash 681653c083ef

Groups

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-content/uploads/*

google favicon

Rule Path
Disallow /wp-content/uploads/*

googlebot-image
googlebot-video

Rule Path
Disallow /wp-content/uploads/*

google-read-aloud

Rule Path
Allow /*

google-read-aloud
googlebot-news
google-speakr
duplexweb-google
googleweblight

Rule Path
Allow /*

adsbot-google-mobile
adsbot-google
mediapartners-google

Rule Path
Allow /*

ccbot

Rule Path
Disallow /

bingbot
yahoo! slurp
teoma
baiduspider
yandex
applebot
exabot
ia_archiver
qwantify
wikiwix
duckduckbot
pinterest
coccocbot
coccocbot-web
yeti
sogou web spider
sogou
seekbot
seekport
seekport crawler
linguee
deusu
turnitinbot

Rule Path
Allow /*

*

Rule Path
Disallow /wp-content/uploads/*

mj12bot
orthogaffe
ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
fast
wget
npbot
webreaper
mojeekbot
cliqzbot
istellabot
psbot
coccocbot-image
spbot
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.festival-beauregard.com/sitemap_index.xml
Back to top

Comments

  • On empeche l'indexation des fichiers sensibles
  • Bloquer Google favicon
  • Bloquer Google Image, vidéo
  • Autoriser Google Recherche vocale (?)
  • Autoriser Google Recherche contenu (?), News
  • Autoriser Google mobile ads et Google ads, media partner
  • Bloquer chatgpt
  • Autoriser Bing, Yahoo, Ask, Baidu, Yandex, Apple, Exalead, Alexa, Qwant, Wikipedia,DuckDuckBot
  • Pour les autres robots
  • spamming bot, badbot et robots trop gourmands
  • On indique au spider le lien vers notre sitemap
  • @@@@@@@@@@@&
  • @/ .@@@@(.&@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@# (
  • (.%,, **% .@@@, %@@@* ,@@@@@@@@@@@@ *
  • &@@ ,@@, &@@& @@@@@ %
Back to top

Warnings

  • 28 invalid lines.
Back to top