raiffeisen-börse.de
robots.txt

Robots Exclusion Standard data for raiffeisen-börse.de

Resource Scan

Scan Details

Site Domain raiffeisen-börse.de
Base Domain raiffeisen-börse.de
Scan Status Ok
Last Scan2024-11-02T20:44:02+00:00
Next Scan 2024-11-09T20:44:02+00:00

Last Scan

Scanned2024-11-02T20:44:02+00:00
URL https://www.raiffeisen-börse.de/robots.txt
Redirect https://www.xn--raiffeisen-brse-ktb.de/robots.txt
Domain IPs 188.172.241.85
Response IP 188.172.241.85
Found Yes
Hash 4ad58f8318b5c558b73a66197b97db843aef276a2f1c8ed6b60e8d1187800732
SimHash 8a9d531bc5f1

Groups

*

Rule Path
Disallow /ajax-add-ad-click/
Disallow /ajax-ad-stats/
Disallow /ajax-dealer-stats/
Disallow /ajax-load-akf/
Disallow /elastic-tests/
Disallow /prg
Disallow /bg/elastic-tests/
Disallow /cs/elastic-tests/
Disallow /es/elastic-tests/
Disallow /el/elastic-tests/
Disallow /en/elastic-tests/
Disallow /fr/elastic-tests/
Disallow /hr/elastic-tests/
Disallow /hu/elastic-tests/
Disallow /it/elastic-tests/
Disallow /nl/elastic-tests/
Disallow /pl/elastic-tests/
Disallow /ro/elastic-tests/
Disallow /sk/elastic-tests/
Disallow /sr/elastic-tests/
Disallow /tr/elastic-tests/
Disallow /uk/elastic-tests/
Disallow /ru/elastic-tests/
Disallow /be/elastic-tests/
Disallow /kk/elastic-tests/
Disallow /iphone/search/options
Disallow /media/general/epaper/
Disallow /ajax-ad-check/
Disallow /ajax-ad-contact/
Disallow /en/ajax-ad-check/
Disallow /en/ajax-ad-contact/
Disallow /fr/ajax-ad-check/
Disallow /fr/ajax-ad-contact/
Disallow /it/ajax-ad-check/
Disallow /it/ajax-ad-contact/
Disallow /cs/ajax-ad-check/
Disallow /cs/ajax-ad-contact/
Disallow /sk/ajax-ad-check/
Disallow /sk/ajax-ad-contact/
Disallow /el/ajax-ad-check/
Disallow /el/ajax-ad-contact/
Disallow /bg/ajax-ad-check/
Disallow /bg/ajax-ad-contact/
Disallow /es/ajax-ad-check/
Disallow /es/ajax-ad-contact/
Disallow /ru/ajax-ad-check/
Disallow /ru/ajax-ad-contact/
Disallow /hu/ajax-ad-check/
Disallow /hu/ajax-ad-contact/
Disallow /ro/ajax-ad-check/
Disallow /ro/ajax-ad-contact/
Disallow /pl/ajax-ad-check/
Disallow /pl/ajax-ad-contact/
Disallow /uk/ajax-ad-check/
Disallow /uk/ajax-ad-contact/
Disallow /hr/ajax-ad-check/
Disallow /hr/ajax-ad-contact/
Disallow /be/ajax-ad-check/
Disallow /be/ajax-ad-contact/
Disallow /kk/ajax-ad-check/
Disallow /kk/ajax-ad-contact/
Disallow /nl/ajax-ad-check/
Disallow /nl/ajax-ad-contact/
Disallow /sr/ajax-ad-check/
Disallow /sr/ajax-ad-contact/
Disallow /tr/ajax-ad-check/
Disallow /tr/ajax-ad-contact/

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Comments

  • Looking for a job? Get in touch and join our team!
  • www.technikboerse.com/content/jobs
  • https://megaindex.com/crawler