haltec.de
robots.txt

Robots Exclusion Standard data for haltec.de

Resource Scan

Scan Details

Site Domain haltec.de
Base Domain haltec.de
Scan Status Ok
Last Scan2024-08-30T15:10:21+00:00
Next Scan 2024-09-29T15:10:21+00:00

Last Scan

Scanned2024-08-30T15:10:21+00:00
URL https://haltec.de/robots.txt
Redirect https://www.haltec.de/robots.txt
Redirect Domain www.haltec.de
Redirect Base haltec.de
Domain IPs 78.47.57.246
Redirect IPs 78.47.57.246
Response IP 78.47.57.246
Found Yes
Hash 9f06d94fa307df8856147dbe852f62d9f452631b978fd112e95b5facb4b6f3ae
SimHash 7b4a48d27df2

Groups

*

Rule Path
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Disallow /typo3temp/
Disallow /cod.pdf
Disallow /404
Disallow /403
Disallow /5xx

adbeat_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

deusu

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

freshbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jobkereso

Rule Path
Disallow /

jooblebot

Rule Path
Disallow /

karriereatbot

Rule Path
Disallow /

kocmohabt

Rule Path
Disallow /

lcc

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

nekstbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

openstat.ru

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spyonweb.com

Rule Path
Disallow /

suchmaschinenoptimierung.de

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

t3census-crawler

Rule Path
Disallow /

techleadzbot

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

vebot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yetibot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Warnings

  • 6 invalid lines.