freeware-base.de
robots.txt

Robots Exclusion Standard data for freeware-base.de

Resource Scan

Scan Details

Site Domain freeware-base.de
Base Domain freeware-base.de
Scan Status Ok
Last Scan2024-10-03T06:18:55+00:00
Next Scan 2024-10-10T06:18:55+00:00

Last Scan

Scanned2024-10-03T06:18:55+00:00
URL https://freeware-base.de/robots.txt
Redirect https://www.freeware-base.de/robots.txt
Redirect Domain www.freeware-base.de
Redirect Base freeware-base.de
Domain IPs 136.243.160.53
Redirect IPs 136.243.160.53
Response IP 136.243.160.53
Found Yes
Hash 9c06dba2889983858cc8e944cb381cb49f49202b1dab3c6994ddfc88a1f64a31
SimHash 5838a3f14cf1

Groups

googlebot

Rule Path
Disallow 98asdfw3ksd09.php
Disallow /*limit%3D
Disallow /admin/
Disallow /blocks/
Disallow /language/
Disallow /securimage/
Disallow /crypt/
Disallow /abuse/
Disallow /adlogger/
Disallow /anzeige/
Disallow /backup/
Disallow /cache/
Disallow /captcha/
Disallow /captcha2/
Disallow /ckeditor/
Disallow /dump/
Disallow /-files/
Disallow /-metadaten/
Allow /freeware-screenshot/
Disallow /import/
Disallow /icon/
Disallow /kcaptcha/
Disallow /phpmyletter/
Disallow /phpqrcode/
Disallow /quickcache/
Disallow /rank/
Disallow /update/
Disallow /up/
Disallow /upload/
Disallow /uploads/
Disallow /modules/Downloads/ajaxrater/db2.php
Disallow /modules/Downloads/ajaxrater/db.php
Disallow software-suche.php
Disallow neue-freeware.php
Allow /*

googlebot-image

Rule Path
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

xovi

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

schrein

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

lex

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

obot

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.freeware-base.de/dlmap.xml
sitemap https://www.freeware-base.de/bildersitemap.xml

Comments

  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror

Warnings

  • 2 invalid lines.