technikboerse.at
robots.txt

Robots Exclusion Standard data for technikboerse.at

Resource Scan

Scan Details

Site Domain technikboerse.at
Base Domain technikboerse.at
Scan Status Ok
Last Scan2024-11-12T01:02:31+00:00
Next Scan 2024-11-19T01:02:31+00:00

Last Scan

Scanned2024-11-12T01:02:31+00:00
URL https://technikboerse.at/robots.txt
Redirect https://www.technikboerse.at/robots.txt
Redirect Domain www.technikboerse.at
Redirect Base technikboerse.at
Domain IPs 159.69.115.96
Redirect IPs 188.172.241.85
Response IP 188.172.241.85
Found Yes
Hash 57edbc004670653045272f7d52a6ca80f1fe0ded80b4b5b34c42e0108e7b2b44
SimHash 8a9d111f85b1

Groups

*

Rule Path
Disallow /ajax-add-ad-click/
Disallow /ajax-ad-stats/
Disallow /ajax-dealer-stats/
Disallow /ajax-load-akf/
Disallow /elastic-tests/
Disallow /prg
Disallow /bg/elastic-tests/
Disallow /cs/elastic-tests/
Disallow /es/elastic-tests/
Disallow /el/elastic-tests/
Disallow /en/elastic-tests/
Disallow /fr/elastic-tests/
Disallow /hr/elastic-tests/
Disallow /hu/elastic-tests/
Disallow /it/elastic-tests/
Disallow /nl/elastic-tests/
Disallow /pl/elastic-tests/
Disallow /ro/elastic-tests/
Disallow /sk/elastic-tests/
Disallow /sr/elastic-tests/
Disallow /tr/elastic-tests/
Disallow /uk/elastic-tests/
Disallow /ru/elastic-tests/
Disallow /be/elastic-tests/
Disallow /kk/elastic-tests/
Disallow /iphone/search/options
Disallow /media/general/epaper/
Disallow /ajax-ad-check/
Disallow /ajax-ad-contact/
Disallow /en/ajax-ad-check/
Disallow /en/ajax-ad-contact/
Disallow /fr/ajax-ad-check/
Disallow /fr/ajax-ad-contact/
Disallow /it/ajax-ad-check/
Disallow /it/ajax-ad-contact/
Disallow /cs/ajax-ad-check/
Disallow /cs/ajax-ad-contact/
Disallow /sk/ajax-ad-check/
Disallow /sk/ajax-ad-contact/
Disallow /el/ajax-ad-check/
Disallow /el/ajax-ad-contact/
Disallow /bg/ajax-ad-check/
Disallow /bg/ajax-ad-contact/
Disallow /es/ajax-ad-check/
Disallow /es/ajax-ad-contact/
Disallow /ru/ajax-ad-check/
Disallow /ru/ajax-ad-contact/
Disallow /hu/ajax-ad-check/
Disallow /hu/ajax-ad-contact/
Disallow /ro/ajax-ad-check/
Disallow /ro/ajax-ad-contact/
Disallow /pl/ajax-ad-check/
Disallow /pl/ajax-ad-contact/
Disallow /uk/ajax-ad-check/
Disallow /uk/ajax-ad-contact/
Disallow /hr/ajax-ad-check/
Disallow /hr/ajax-ad-contact/
Disallow /be/ajax-ad-check/
Disallow /be/ajax-ad-contact/
Disallow /kk/ajax-ad-check/
Disallow /kk/ajax-ad-contact/
Disallow /nl/ajax-ad-check/
Disallow /nl/ajax-ad-contact/
Disallow /sr/ajax-ad-check/
Disallow /sr/ajax-ad-contact/
Disallow /tr/ajax-ad-check/
Disallow /tr/ajax-ad-contact/

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.technikboerse.at/sitemap-tbat.xml

Comments

  • Looking for a job? Get in touch and join our team!
  • www.technikboerse.com/content/jobs
  • https://megaindex.com/crawler