donnons.org
robots.txt

Robots Exclusion Standard data for donnons.org

Resource Scan

Scan Details

Site Domain donnons.org
Base Domain donnons.org
Scan Status Ok
Last Scan2024-11-09T06:10:40+00:00
Next Scan 2024-11-16T06:10:40+00:00

Last Scan

Scanned2024-11-09T06:10:40+00:00
URL https://donnons.org/robots.txt
Domain IPs 37.187.190.103
Response IP 37.187.190.103
Found Yes
Hash 69c420a942cc8cfa4218e6a192f163b663df23e11494c91e1f0e5d19c860ae0f
SimHash 2a54d3f0d5b0

Groups

google
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
mediapartners-google
mediapartners
adsbot-google
adsbot-google-mobile-apps
bingbot
msnbot
msnbot-media
adidxbot
bingpreview
slurp
orangebot
duckduckbot
facebookexternalhit
pinterest
twitterbot

Rule Path
Disallow
Disallow /weepeggle
Disallow /*undefined
Disallow *.php
Disallow /actualites
Disallow /actus
Disallow /https*
Disallow /livreor
Disallow /profil/compte*
Disallow /profil/donnes*
Disallow /connexion

yandex

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Comments

  • ------------------------------------------------------------------------------
  • Whitelist
  • ------------------------------------------------------------------------------
  • Googlebot
  • Bing
  • Yahoo
  • Orange
  • DuckDuckGo
  • Social network
  • ------------------------------------------------------------------------------
  • Blacklist
  • ------------------------------------------------------------------------------
  • Yandex
  • Goo
  • Naver
  • Baidu
  • SoGou
  • Youdao
  • GrapeshotCrawler
  • Majestic-12
  • Exabot
  • Alexa