sphere-immo.com
robots.txt

Robots Exclusion Standard data for sphere-immo.com

Resource Scan

Scan Details

Site Domain sphere-immo.com
Base Domain sphere-immo.com
Scan Status Ok
Last Scan2024-09-17T07:54:13+00:00
Next Scan 2024-10-17T07:54:13+00:00

Last Scan

Scanned2024-09-17T07:54:13+00:00
URL https://sphere-immo.com/robots.txt
Domain IPs 81.252.9.200
Response IP 81.252.9.200
Found Yes
Hash a17889b184fd80620c5dc73f5f2987689b14580383c2d4c584b76b0ea44325fb
SimHash 3b36f3007716

Groups

*

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*?

googlebot-image

Rule Path
Disallow /*?

googlebot-mobile

Rule Path
Disallow /*?

mediapartners-google

Rule Path
Disallow /*?

msnbot

Rule Path
Disallow /*?

msnbot-media

Rule Path
Disallow /*?

slurp

Rule Path
Disallow /*?

teoma

Rule Path
Disallow /*?

yandex

Rule Path
Disallow /*?

scoutjet

Rule Path
Disallow /*?

rogerbot

Rule Path
Disallow /*?

baiduspider

Rule Path
Disallow /*?

robozilla

Rule Path
Disallow /*?

scoutjet

Rule Path
Disallow /*?

*

Rule Path
Disallow /*?

linkdexbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

ng/2.0

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

f-six

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

vocusbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ezooms.bot

Rule Path
Disallow /

skimlinks.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

wikiwix-bot

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

semantissimo

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

lemonsources

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

language-tools.com

Rule Path
Disallow /

trec-kba-bot

Rule Path
Disallow /

checkprivacy.or.kr

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

havij

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mireobot

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

bot clicker

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

admedia

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grepnetstat.com

Rule Path
Disallow /

genieo

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sindup

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

netseer.com

Rule Path
Disallow /

nagios

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

ning/1.0

Rule Path
Disallow /

feedretriever

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

argus presse

Rule Path
Disallow /

ibm ica crawler

Rule Path
Disallow /

nutch agent

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

mynutchtest

Rule Path
Disallow /

admantx

Rule Path
Disallow /

genieo.com

Rule Path
Disallow /

mixdata.com

Rule Path
Disallow /

www.wise-guys.nl

Rule Path
Disallow /

www.wesee.com

Rule Path
Disallow /

wesee

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

www.200please.com

Rule Path
Disallow /

ubermetrics-technologies

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wasalive

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

infohelfer

Rule Path
Disallow /

acoon

Rule Path
Disallow /

webnl

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

nutch

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

postpost

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

attentio

Rule Path
Disallow /

admantx

Rule Path
Disallow /
Disallow /BATS/
Disallow /beta/
Disallow /beta2/
Disallow /business/
Disallow /cgi-bin/
Disallow /css/
Disallow /db/
Disallow /export/
Disallow /fct/
Disallow /fonts/
Disallow /images/
Disallow /js/
Disallow /libs/
Disallow /models/
Disallow /mailing/
Disallow /myspherebeta/
Disallow /myspheredev/
Disallow /preprod/
Disallow /OLD/
Disallow /pinel/
Disallow /plugins/
Disallow /private/
Disallow /puce-google/
Disallow /recherche/
Disallow /refonteSite/
Disallow /save_cd/
Disallow /signatures/
Disallow /statsRDV/
Disallow /temp/
Disallow /test/
Disallow /uploads/
Disallow /new-si/
Disallow /extranet/
Disallow /ressources/geojson/
Disallow /pour-investir-regions/
Disallow /pour-investir-departements/
Disallow /pour-habiter-regions/
Disallow /pour-habiter-departements/
Disallow /pourquoi-le-neuf/
Disallow /conseils/
Disallow /outils/
Disallow /informations/
Disallow /jura/
Disallow /indre/
Disallow /isere/

Other Records

Field Value
sitemap https://www.sphere-immo.com/sitemap.xml
sitemap https://www.sphere-immo.com/sitemap_contenus.xml
sitemap https://www.sphere-immo.com/sitemap_lots_1.xml
sitemap https://www.sphere-immo.com/sitemap_lots_2.xml
sitemap https://www.sphere-immo.com/sitemap_lots_3.xml
sitemap https://www.sphere-immo.com/sitemap_programmes.xml
sitemap https://www.sphere-immo.com/sitemap_programmes_amp.xml

Comments

  • User-agent: *
  • User-agent: Googlebot
  • Allow: /
  • User-agent: Googlebot-Image
  • Allow: /
  • User-agent: Googlebot-Mobile
  • Allow: /
  • User-agent: Yahoo! Slurp
  • Allow: /
  • Google
  • Google image
  • Google Mobile
  • Google Partenaire
  • Bing
  • Yahoo
  • Ask
  • Yandex (Russian search engine)
  • Blekko.com Search Engine
  • RogerBot Search Engine
  • Baidu Search Engine
  • Robozilla Search Engine
  • Blekko Search Engine
  • All other crawler