Log In Sign Up

enigmes.info
robots.txt

Robots Exclusion Standard data for enigmes.info

Resource Scan

Scan Details

Site Domain enigmes.info
Base Domain enigmes.info
Scan Status Ok
Last Scan2024-10-01T02:31:32+00:00
Next Scan 2024-10-08T02:31:32+00:00

Last Scan

Scanned2024-10-01T02:31:32+00:00
URL https://enigmes.info/robots.txt
Domain IPs 37.59.255.218
Response IP 37.59.255.218
Found Yes
Hash 3a5ad171009cbcf570c15105a48f26a14d7ba94cd8f4f542150571f4ea78aa17
SimHash 795451c0c3ab

Groups

googlebot
googlebot-image
googlebot-video

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-content/plugins/link-juice-optimizer/public/js/link-juice-optimizer.js

google-read-aloud

Rule Path
Allow /*

google-read-aloud
googlebot-news
google-speakr
duplexweb-google
googleweblight

Rule Path
Allow /*

adsbot-google-mobile
adsbot-google
mediapartners-google

Rule Path
Allow /*

bingbot
yahoo! slurp
teoma
baiduspider
yandex
applebot
exabot
ia_archiver
qwantify
wikiwix
duckduckbot
pinterest
coccocbot
coccocbot-web
yeti
sogou web spider
sogou
seekbot
seekport
seekport crawler
linguee
deusu
turnitinbot

Rule Path
Allow /*
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-content/plugins/link-juice-optimizer/public/js/link-juice-optimizer.js

*

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-content/plugins/link-juice-optimizer/public/js/link-juice-optimizer.js

mj12bot
orthogaffe
ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
fast
wget
npbot
webreaper
mojeekbot
cliqzbot
istellabot
psbot
coccocbot-image
spbot
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.enigmes.info/sitemap_index.xml
Back to top

Comments

  • On empeche l'indexation des fichiers sensibles
  • Autoriser Google Recherche vocale (?)
  • Autoriser Google Recherche contenu (?), News
  • Autoriser Google mobile ads et Google ads, media partner
  • Autoriser Bing, Yahoo, Ask, Baidu, Yandex, Apple, Exalead, Alexa, Qwant, Wikipedia,DuckDuckBot
  • Pour les autres robots
  • On empeche l'indexation des fichiers sensibles
  • spamming bot, badbot et robots trop gourmands
  • On indique au spider le lien vers notre sitemap
  • @@@@@@@@@@@&
  • @/ .@@@@(.&@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@# (
  • (.%,, **% .@@@, %@@@* ,@@@@@@@@@@@@ *
  • &@@ ,@@, &@@& @@@@@ %
Back to top

Warnings

  • 28 invalid lines.
Back to top