Log In Sign Up

online-vergleich-versicherung.de
robots.txt

Robots Exclusion Standard data for online-vergleich-versicherung.de

Resource Scan

Scan Details

Site Domain online-vergleich-versicherung.de
Base Domain online-vergleich-versicherung.de
Scan Status Ok
Last Scan2024-10-06T04:59:40+00:00
Next Scan 2024-10-13T04:59:40+00:00

Last Scan

Scanned2024-10-06T04:59:40+00:00
URL https://online-vergleich-versicherung.de/robots.txt
Redirect https://www.online-vergleich-versicherung.de/robots.txt
Redirect Domain www.online-vergleich-versicherung.de
Redirect Base online-vergleich-versicherung.de
Domain IPs 104.21.90.24, 172.67.151.113, 2606:4700:3030::6815:5a18, 2606:4700:3037::ac43:9771
Redirect IPs 104.21.90.24, 172.67.151.113, 2606:4700:3030::6815:5a18, 2606:4700:3037::ac43:9771
Response IP 172.67.151.113
Found Yes
Hash 1fbccd8d8f804b66651e3b49e51112691e83d755b351a88589e47bd8e910166f
SimHash aa3802306cfb

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/cache/cachify/
Disallow /*?*post_type=snippets
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/
Disallow */trackback/
Disallow */comments/
Disallow /danke-fuer-ihr-vertrauen/

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

schrein

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

lex

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

obot

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.online-vergleich-versicherung.de/sitemap_index.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top