Log In Sign Up

autokostencheck.de
robots.txt

Robots Exclusion Standard data for autokostencheck.de

Resource Scan

Scan Details

Site Domain autokostencheck.de
Base Domain autokostencheck.de
Scan Status Ok
Last Scan2024-09-25T19:53:34+00:00
Next Scan 2024-10-02T19:53:34+00:00

Last Scan

Scanned2024-09-25T19:53:34+00:00
URL https://autokostencheck.de/robots.txt
Redirect https://www.autokostencheck.de/robots.txt
Redirect Domain www.autokostencheck.de
Redirect Base autokostencheck.de
Domain IPs 46.163.78.70
Redirect IPs 46.163.78.70
Response IP 46.163.78.70
Found Yes
Hash 718dbfa4aeb4f21a50e11b9e8c08554bf3c1ee4887f9affe2c67dcc5c1c39d0a
SimHash 7307727319a7

Groups

*

Rule Path
Disallow /kostenrechner.php
Disallow /kostenrechner_kombiniert.php
Disallow /versicherung.php
Disallow /einstellungen.php
Disallow /kostenvergleich.php
Disallow /redirect.php
Disallow /mypage.php
Disallow /zeige/
Disallow /incs/
Disallow /php/
Disallow /autoreifen/
Disallow /tarifberechnung/
Disallow /cd.autokostencheck.de/
Disallow /schwerpunkte/newsmenu-external.html
Allow /bild/models/
Allow /bild/models480/
Allow /ads.txt

mediapartners-google

Rule Path
Disallow

sitecheck.internetseer.com

Rule Path
Disallow /
Allow /ads.txt

petalbot

Rule Path
Disallow /
Allow /ads.txt

zealbot

Rule Path
Disallow /
Allow /ads.txt

msiecrawler

Rule Path
Disallow /
Allow /ads.txt

sitesnagger

Rule Path
Disallow /
Allow /ads.txt

webstripper

Rule Path
Disallow /
Allow /ads.txt

webcopier

Rule Path
Disallow /
Allow /ads.txt

fetch

Rule Path
Disallow /
Allow /ads.txt

offline explorer

Rule Path
Disallow /
Allow /ads.txt

teleport

Rule Path
Disallow /
Allow /ads.txt

teleportpro

Rule Path
Disallow /
Allow /ads.txt

webzip

Rule Path
Disallow /
Allow /ads.txt

linko

Rule Path
Disallow /
Allow /ads.txt

httrack

Rule Path
Disallow /
Allow /ads.txt

microsoft.url.control

Rule Path
Disallow /
Allow /ads.txt

xenu

Rule Path
Disallow /
Allow /ads.txt

larbin

Rule Path
Disallow /
Allow /ads.txt

libwww

Rule Path
Disallow /
Allow /ads.txt

zyborg

Rule Path
Disallow /
Allow /ads.txt

download ninja

Rule Path
Disallow /
Allow /ads.txt

proximic

Rule Path
Disallow /
Allow /ads.txt

hyscore

Rule Path
Disallow /
Allow /ads.txt

blexbot

Rule Path
Disallow /
Allow /ads.txt
Disallow /
Allow /ads.txtkirra

Other Records

Field Value
crawl-delay 1

botrighthere

Rule Path
Disallow /
Allow /ads.txt

webzip

Rule Path
Disallow /
Allow /ads.txt

larbin

Rule Path
Disallow /
Allow /ads.txt

b2w/0.1

Rule Path
Disallow /
Allow /ads.txt

copernic

Rule Path
Disallow /
Allow /ads.txt

psbot

Rule Path
Disallow /
Allow /ads.txt

python-urllib

Rule Path
Disallow /
Allow /ads.txt

url_spider_pro

Rule Path
Disallow /
Allow /ads.txt

cherrypicker

Rule Path
Disallow /
Allow /ads.txt

emailcollector

Rule Path
Disallow /
Allow /ads.txt

emailsiphon

Rule Path
Disallow /
Allow /ads.txt

webbandit

Rule Path
Disallow /
Allow /ads.txt

emailwolf

Rule Path
Disallow /
Allow /ads.txt

extractorpro

Rule Path
Disallow /
Allow /ads.txt

copyrightcheck

Rule Path
Disallow /
Allow /ads.txt

crescent

Rule Path
Disallow /
Allow /ads.txt

sitesnagger

Rule Path
Disallow /
Allow /ads.txt

prowebwalker

Rule Path
Disallow /
Allow /ads.txt

cheesebot

Rule Path
Disallow /
Allow /ads.txt

lnspiderguy

Rule Path
Disallow /
Allow /ads.txt

alexibot

Rule Path
Disallow /
Allow /ads.txt

teleport

Rule Path
Disallow /
Allow /ads.txt

teleportpro

Rule Path
Disallow /
Allow /ads.txt

miixpc

Rule Path
Disallow /
Allow /ads.txt

telesoft

Rule Path
Disallow /
Allow /ads.txt

website quester

Rule Path
Disallow /
Allow /ads.txt

webzip

Rule Path
Disallow /
Allow /ads.txt

moget/2.1

Rule Path
Disallow /
Allow /ads.txt

webzip/4.0

Rule Path
Disallow /
Allow /ads.txt

webstripper

Rule Path
Disallow /
Allow /ads.txt

websauger

Rule Path
Disallow /
Allow /ads.txt

webcopier

Rule Path
Disallow /
Allow /ads.txt

netants

Rule Path
Disallow /
Allow /ads.txt

mister pix

Rule Path
Disallow /
Allow /ads.txt

webauto

Rule Path
Disallow /
Allow /ads.txt

thenomad

Rule Path
Disallow /
Allow /ads.txt

www-collector-e

Rule Path
Disallow /
Allow /ads.txt

rma

Rule Path
Disallow /
Allow /ads.txt

libweb/clshttp

Rule Path
Disallow /
Allow /ads.txt

asterias

Rule Path
Disallow /
Allow /ads.txt

httplib

Rule Path
Disallow /
Allow /ads.txt

turingos

Rule Path
Disallow /
Allow /ads.txt

spanner

Rule Path
Disallow /
Allow /ads.txt

infonavirobot

Rule Path
Disallow /
Allow /ads.txt

harvest/1.5

Rule Path
Disallow /
Allow /ads.txt

bullseye/1.0

Rule Path
Disallow /
Allow /ads.txt

mozilla/4.0 (compatible; bullseye; windows 95)

Rule Path
Disallow /
Allow /ads.txt

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /
Allow /ads.txt

cherrypickerse/1.0

Rule Path
Disallow /
Allow /ads.txt

cherrypickerelite/1.0

Rule Path
Disallow /
Allow /ads.txt

webbandit/3.50

Rule Path
Disallow /
Allow /ads.txt

nicerspro

Rule Path
Disallow /
Allow /ads.txt

microsoft url control - 5.01.4511

Rule Path
Disallow /
Allow /ads.txt

dittospyder

Rule Path
Disallow /
Allow /ads.txt

foobot

Rule Path
Disallow /
Allow /ads.txt

spankbot

Rule Path
Disallow /
Allow /ads.txt

botalot

Rule Path
Disallow /
Allow /ads.txt

lwp-trivial/1.34

Rule Path
Disallow /
Allow /ads.txt

lwp-trivial

Rule Path
Disallow /
Allow /ads.txt

bunnyslippers

Rule Path
Disallow /
Allow /ads.txt

microsoft url control - 6.00.8169

Rule Path
Disallow /
Allow /ads.txt

urly warning

Rule Path
Disallow /
Allow /ads.txt

wget/1.6

Rule Path
Disallow /
Allow /ads.txt

wget/1.5.3

Rule Path
Disallow /
Allow /ads.txt

wget

Rule Path
Disallow /
Allow /ads.txt

linkwalker

Rule Path
Disallow /
Allow /ads.txt

cosmos

Rule Path
Disallow /
Allow /ads.txt

moget

Rule Path
Disallow /
Allow /ads.txt

hloader

Rule Path
Disallow /
Allow /ads.txt

humanlinks

Rule Path
Disallow /
Allow /ads.txt

linkextractorpro

Rule Path
Disallow /
Allow /ads.txt

offline explorer

Rule Path
Disallow /
Allow /ads.txt

mata hari

Rule Path
Disallow /
Allow /ads.txt

lexibot

Rule Path
Disallow /
Allow /ads.txt

web image collector

Rule Path
Disallow /
Allow /ads.txt

the intraformant

Rule Path
Disallow /
Allow /ads.txt

true_robot/1.0

Rule Path
Disallow /
Allow /ads.txt

true_robot

Rule Path
Disallow /
Allow /ads.txt

blowfish/1.0

Rule Path
Disallow /
Allow /ads.txt

jennybot

Rule Path
Disallow /
Allow /ads.txt

miixpc/4.2

Rule Path
Disallow /
Allow /ads.txt

builtbottough

Rule Path
Disallow /
Allow /ads.txt

propowerbot/2.14

Rule Path
Disallow /
Allow /ads.txt

backdoorbot/1.0

Rule Path
Disallow /
Allow /ads.txt

tocrawl/urldispatcher

Rule Path
Disallow /
Allow /ads.txt

webenhancer

Rule Path
Disallow /
Allow /ads.txt

suzuran

Rule Path
Disallow /
Allow /ads.txt

tighttwatbot

Rule Path
Disallow /
Allow /ads.txt

vci webviewer vci webviewer win32

Rule Path
Disallow /
Allow /ads.txt

vci

Rule Path
Disallow /
Allow /ads.txt

szukacz/1.4

Rule Path
Disallow /
Allow /ads.txt

queryn metasearch

Rule Path
Disallow /
Allow /ads.txt

openfind data gatherer

Rule Path
Disallow /
Allow /ads.txt

openfind

Rule Path
Disallow /
Allow /ads.txt

xenu's link sleuth 1.1c

Rule Path
Disallow /
Allow /ads.txt

xenu's

Rule Path
Disallow /
Allow /ads.txt

zeus

Rule Path
Disallow /
Allow /ads.txt

repomonkey bait & tackle/v1.01

Rule Path
Disallow /
Allow /ads.txt

repomonkey

Rule Path
Disallow /
Allow /ads.txt

microsoft url control

Rule Path
Disallow /
Allow /ads.txt

openbot

Rule Path
Disallow /
Allow /ads.txt

url control

Rule Path
Disallow /
Allow /ads.txt

zeus link scout

Rule Path
Disallow /
Allow /ads.txt

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /
Allow /ads.txt

webster pro

Rule Path
Disallow /
Allow /ads.txt

erocrawler

Rule Path
Disallow /
Allow /ads.txt

linkscan/8.1a unix

Rule Path
Disallow /
Allow /ads.txt

keyword density/0.9

Rule Path
Disallow /
Allow /ads.txt

kenjin spider

Rule Path
Disallow /
Allow /ads.txt

iron33/1.0.2

Rule Path
Disallow /
Allow /ads.txt

bookmark search tool

Rule Path
Disallow /
Allow /ads.txt

getright/4.2

Rule Path
Disallow /
Allow /ads.txt

fairad client

Rule Path
Disallow /
Allow /ads.txt

gaisbot

Rule Path
Disallow /
Allow /ads.txt

aqua_products

Rule Path
Disallow /
Allow /ads.txt

radiation retriever 1.1

Rule Path
Disallow /
Allow /ads.txt

flaming attackbot

Rule Path
Disallow /
Allow /ads.txt

oracle ultra search

Rule Path
Disallow /
Allow /ads.txt

msiecrawler

Rule Path
Disallow /
Allow /ads.txt

perman

Rule Path
Disallow /
Allow /ads.txt

searchpreview

Rule Path
Disallow /
Allow /ads.txt

turnitinbot

Rule Path
Disallow /
Allow /ads.txt

wget

Rule Path
Disallow /
Allow /ads.txt

extractorpro

Rule Path
Disallow /
Allow /ads.txt

webzip/4.21

Rule Path
Disallow /
Allow /ads.txt

webzip/5.0

Rule Path
Disallow /
Allow /ads.txt

httrack 3.0

Rule Path
Disallow /
Allow /ads.txt

turnitinbot/1.5

Rule Path
Disallow /
Allow /ads.txt

webcopier v3.2a

Rule Path
Disallow /
Allow /ads.txt

webcapture 2.0

Rule Path
Disallow /
Allow /ads.txt

webcopier v.2.2

Rule Path
Disallow /
Allow /ads.txt

admantx

Rule Path
Disallow /
Allow /ads.txt

aibot

Rule Path
Disallow /
Allow /ads.txt

alittle client

Rule Path
Disallow /
Allow /ads.txt

aspseek

Rule Path
Disallow /
Allow /ads.txt

abonti

Rule Path
Disallow /
Allow /ads.txt

aboundex

Rule Path
Disallow /
Allow /ads.txt

aboundexbot

Rule Path
Disallow /
Allow /ads.txt

acunetix

Rule Path
Disallow /
Allow /ads.txt

afd-verbotsverfahren

Rule Path
Disallow /
Allow /ads.txt

ahrefsbot

Rule Path
Disallow /
Allow /ads.txt

aihitbot

Rule Path
Disallow /
Allow /ads.txt

aipbot

Rule Path
Disallow /
Allow /ads.txt

alexibot

Rule Path
Disallow /
Allow /ads.txt

allsubmitter

Rule Path
Disallow /
Allow /ads.txt

alligator

Rule Path
Disallow /
Allow /ads.txt

alphabot

Rule Path
Disallow /
Allow /ads.txt

anarchie

Rule Path
Disallow /
Allow /ads.txt

anarchy

Rule Path
Disallow /
Allow /ads.txt

anarchy99

Rule Path
Disallow /
Allow /ads.txt

ankit

Rule Path
Disallow /
Allow /ads.txt

anthill

Rule Path
Disallow /
Allow /ads.txt

apexoo

Rule Path
Disallow /
Allow /ads.txt

aspiegel

Rule Path
Disallow /
Allow /ads.txt

asterias

Rule Path
Disallow /
Allow /ads.txt

atomseobot

Rule Path
Disallow /
Allow /ads.txt

attach

Rule Path
Disallow /
Allow /ads.txt

awariorssbot

Rule Path
Disallow /
Allow /ads.txt

awariosmartbot

Rule Path
Disallow /
Allow /ads.txt

bbbike

Rule Path
Disallow /
Allow /ads.txt

bdcbot

Rule Path
Disallow /
Allow /ads.txt

bdfetch

Rule Path
Disallow /
Allow /ads.txt

blexbot

Rule Path
Disallow /
Allow /ads.txt

backdoorbot

Rule Path
Disallow /
Allow /ads.txt

backstreet

Rule Path
Disallow /
Allow /ads.txt

backweb

Rule Path
Disallow /
Allow /ads.txt

backlink-ceck

Rule Path
Disallow /
Allow /ads.txt

backlinkcrawler

Rule Path
Disallow /
Allow /ads.txt

badass

Rule Path
Disallow /
Allow /ads.txt

bandit

Rule Path
Disallow /
Allow /ads.txt

barkrowler

Rule Path
Disallow /
Allow /ads.txt

batchftp

Rule Path
Disallow /
Allow /ads.txt

battleztar bazinga

Rule Path
Disallow /
Allow /ads.txt

betabot

Rule Path
Disallow /
Allow /ads.txt

bigfoot

Rule Path
Disallow /
Allow /ads.txt

bitacle

Rule Path
Disallow /
Allow /ads.txt

blackwidow

Rule Path
Disallow /
Allow /ads.txt

black hole

Rule Path
Disallow /
Allow /ads.txt

blackboard

Rule Path
Disallow /
Allow /ads.txt

blow

Rule Path
Disallow /
Allow /ads.txt

blowfish

Rule Path
Disallow /
Allow /ads.txt

boardreader

Rule Path
Disallow /
Allow /ads.txt

bolt

Rule Path
Disallow /
Allow /ads.txt

botalot

Rule Path
Disallow /
Allow /ads.txt

brandprotect

Rule Path
Disallow /
Allow /ads.txt

brandwatch

Rule Path
Disallow /
Allow /ads.txt

buck

Rule Path
Disallow /
Allow /ads.txt

buddy

Rule Path
Disallow /
Allow /ads.txt

builtbottough

Rule Path
Disallow /
Allow /ads.txt

builtwith

Rule Path
Disallow /
Allow /ads.txt

bullseye

Rule Path
Disallow /
Allow /ads.txt

bunnyslippers

Rule Path
Disallow /
Allow /ads.txt

buzzsumo

Rule Path
Disallow /
Allow /ads.txt

catexplorador

Rule Path
Disallow /
Allow /ads.txt

ccbot

Rule Path
Disallow /
Allow /ads.txt

code87

Rule Path
Disallow /
Allow /ads.txt

cshttp

Rule Path
Disallow /
Allow /ads.txt

calculon

Rule Path
Disallow /
Allow /ads.txt

cazoodlebot

Rule Path
Disallow /
Allow /ads.txt

cegbfeieh

Rule Path
Disallow /
Allow /ads.txt

censysinspect

Rule Path
Disallow /
Allow /ads.txt

cheteam

Rule Path
Disallow /
Allow /ads.txt

cheesebot

Rule Path
Disallow /
Allow /ads.txt

cherrypicker

Rule Path
Disallow /
Allow /ads.txt

chinaclaw

Rule Path
Disallow /
Allow /ads.txt

chlooe

Rule Path
Disallow /
Allow /ads.txt

citoid

Rule Path
Disallow /
Allow /ads.txt

claritybot

Rule Path
Disallow /
Allow /ads.txt

cliqzbot

Rule Path
Disallow /
Allow /ads.txt

cloud mapping

Rule Path
Disallow /
Allow /ads.txt

cocolyzebot

Rule Path
Disallow /
Allow /ads.txt

cogentbot

Rule Path
Disallow /
Allow /ads.txt

collector

Rule Path
Disallow /
Allow /ads.txt

copier

Rule Path
Disallow /
Allow /ads.txt

copyrightcheck

Rule Path
Disallow /
Allow /ads.txt

copyscape

Rule Path
Disallow /
Allow /ads.txt

cosmos

Rule Path
Disallow /
Allow /ads.txt

craftbot

Rule Path
Disallow /
Allow /ads.txt

crawling at home project

Rule Path
Disallow /
Allow /ads.txt

crazywebcrawler

Rule Path
Disallow /
Allow /ads.txt

crescent

Rule Path
Disallow /
Allow /ads.txt

crunchbot

Rule Path
Disallow /
Allow /ads.txt

curious

Rule Path
Disallow /
Allow /ads.txt

custo

Rule Path
Disallow /
Allow /ads.txt

cyotekwebcopy

Rule Path
Disallow /
Allow /ads.txt

dblbot

Rule Path
Disallow /
Allow /ads.txt

diibot

Rule Path
Disallow /
Allow /ads.txt

dsearch

Rule Path
Disallow /
Allow /ads.txt

dts agent

Rule Path
Disallow /
Allow /ads.txt

datacha0s

Rule Path
Disallow /
Allow /ads.txt

databasedrivermysqli

Rule Path
Disallow /
Allow /ads.txt

demon

Rule Path
Disallow /
Allow /ads.txt

deusu

Rule Path
Disallow /
Allow /ads.txt

devil

Rule Path
Disallow /
Allow /ads.txt

digincore

Rule Path
Disallow /
Allow /ads.txt

digitalpebble

Rule Path
Disallow /
Allow /ads.txt

dirbuster

Rule Path
Disallow /
Allow /ads.txt

disco

Rule Path
Disallow /
Allow /ads.txt

discobot

Rule Path
Disallow /
Allow /ads.txt

discoverybot

Rule Path
Disallow /
Allow /ads.txt

dispatch

Rule Path
Disallow /
Allow /ads.txt

dittospyder

Rule Path
Disallow /
Allow /ads.txt

dnbcrawler-analytics

Rule Path
Disallow /
Allow /ads.txt

dnyzbot

Rule Path
Disallow /
Allow /ads.txt

domcopbot

Rule Path
Disallow /
Allow /ads.txt

domainappender

Rule Path
Disallow /
Allow /ads.txt

domaincrawler

Rule Path
Disallow /
Allow /ads.txt

domainsigmacrawler

Rule Path
Disallow /
Allow /ads.txt

domainstatsbot

Rule Path
Disallow /
Allow /ads.txt

domains project

Rule Path
Disallow /
Allow /ads.txt

dotbot

Rule Path
Disallow /
Allow /ads.txt

download wonder

Rule Path
Disallow /
Allow /ads.txt

dragonfly

Rule Path
Disallow /
Allow /ads.txt

drip

Rule Path
Disallow /
Allow /ads.txt

eccp/1.0

Rule Path
Disallow /
Allow /ads.txt

email siphon

Rule Path
Disallow /
Allow /ads.txt

email wolf

Rule Path
Disallow /
Allow /ads.txt

easydl

Rule Path
Disallow /
Allow /ads.txt

ebingbong

Rule Path
Disallow /
Allow /ads.txt

ecxi

Rule Path
Disallow /
Allow /ads.txt

eirgrabber

Rule Path
Disallow /
Allow /ads.txt

erocrawler

Rule Path
Disallow /
Allow /ads.txt

evil

Rule Path
Disallow /
Allow /ads.txt

exabot

Rule Path
Disallow /
Allow /ads.txt

express webpictures

Rule Path
Disallow /
Allow /ads.txt

extlinksbot

Rule Path
Disallow /
Allow /ads.txt

extractor

Rule Path
Disallow /
Allow /ads.txt

extractorpro

Rule Path
Disallow /
Allow /ads.txt

extreme picture finder

Rule Path
Disallow /
Allow /ads.txt

eyenetie

Rule Path
Disallow /
Allow /ads.txt

ezooms

Rule Path
Disallow /
Allow /ads.txt

fdm

Rule Path
Disallow /
Allow /ads.txt

fhscan

Rule Path
Disallow /
Allow /ads.txt

femtosearchbot

Rule Path
Disallow /
Allow /ads.txt

fimap

Rule Path
Disallow /
Allow /ads.txt

firefox/7.0

Rule Path
Disallow /
Allow /ads.txt

flashget

Rule Path
Disallow /
Allow /ads.txt

flunky

Rule Path
Disallow /
Allow /ads.txt

foobot

Rule Path
Disallow /
Allow /ads.txt

freeuploader

Rule Path
Disallow /
Allow /ads.txt

frontpage

Rule Path
Disallow /
Allow /ads.txt

fuzz

Rule Path
Disallow /
Allow /ads.txt

fyberspider

Rule Path
Disallow /
Allow /ads.txt

fyrebot

Rule Path
Disallow /
Allow /ads.txt

g-i-g-a-b-o-t

Rule Path
Disallow /
Allow /ads.txt

gt::www

Rule Path
Disallow /
Allow /ads.txt

galaxybot

Rule Path
Disallow /
Allow /ads.txt

genieo

Rule Path
Disallow /
Allow /ads.txt

germcrawler

Rule Path
Disallow /
Allow /ads.txt

getright

Rule Path
Disallow /
Allow /ads.txt

getweb

Rule Path
Disallow /
Allow /ads.txt

getintent

Rule Path
Disallow /
Allow /ads.txt

gigabot

Rule Path
Disallow /
Allow /ads.txt

go!zilla

Rule Path
Disallow /
Allow /ads.txt

go-ahead-got-it

Rule Path
Disallow /
Allow /ads.txt

gozilla

Rule Path
Disallow /
Allow /ads.txt

gotit

Rule Path
Disallow /
Allow /ads.txt

grabnet

Rule Path
Disallow /
Allow /ads.txt

grabber

Rule Path
Disallow /
Allow /ads.txt

grafula

Rule Path
Disallow /
Allow /ads.txt

grapefx

Rule Path
Disallow /
Allow /ads.txt

grapeshotcrawler

Rule Path
Disallow /
Allow /ads.txt

gridbot

Rule Path
Disallow /
Allow /ads.txt

headmasterseo

Rule Path
Disallow /
Allow /ads.txt

hmview

Rule Path
Disallow /
Allow /ads.txt

htmlparser

Rule Path
Disallow /
Allow /ads.txt

http::lite

Rule Path
Disallow /
Allow /ads.txt

httrack

Rule Path
Disallow /
Allow /ads.txt

haansoft

Rule Path
Disallow /
Allow /ads.txt

haosouspider

Rule Path
Disallow /
Allow /ads.txt

harvest

Rule Path
Disallow /
Allow /ads.txt

havij

Rule Path
Disallow /
Allow /ads.txt

heritrix

Rule Path
Disallow /
Allow /ads.txt

hloader

Rule Path
Disallow /
Allow /ads.txt

honolulubot

Rule Path
Disallow /
Allow /ads.txt

humanlinks

Rule Path
Disallow /
Allow /ads.txt

hybridbot

Rule Path
Disallow /
Allow /ads.txt

idbte4m

Rule Path
Disallow /
Allow /ads.txt

idbot

Rule Path
Disallow /
Allow /ads.txt

irlbot

Rule Path
Disallow /
Allow /ads.txt

iblog

Rule Path
Disallow /
Allow /ads.txt

id-search

Rule Path
Disallow /
Allow /ads.txt

ilsebot

Rule Path
Disallow /
Allow /ads.txt

image fetch

Rule Path
Disallow /
Allow /ads.txt

image sucker

Rule Path
Disallow /
Allow /ads.txt

indeedbot

Rule Path
Disallow /
Allow /ads.txt

indy library

Rule Path
Disallow /
Allow /ads.txt

infonavirobot

Rule Path
Disallow /
Allow /ads.txt

infotekies

Rule Path
Disallow /
Allow /ads.txt

intelliseek

Rule Path
Disallow /
Allow /ads.txt

interget

Rule Path
Disallow /
Allow /ads.txt

internetseer

Rule Path
Disallow /
Allow /ads.txt

internet ninja

Rule Path
Disallow /
Allow /ads.txt

iria

Rule Path
Disallow /
Allow /ads.txt

iskanie

Rule Path
Disallow /
Allow /ads.txt

istellabot

Rule Path
Disallow /
Allow /ads.txt

joc web spider

Rule Path
Disallow /
Allow /ads.txt

jamesbot

Rule Path
Disallow /
Allow /ads.txt

jbrofuzz

Rule Path
Disallow /
Allow /ads.txt

jennybot

Rule Path
Disallow /
Allow /ads.txt

jetcar

Rule Path
Disallow /
Allow /ads.txt

jetty

Rule Path
Disallow /
Allow /ads.txt

jikespider

Rule Path
Disallow /
Allow /ads.txt

joomla

Rule Path
Disallow /
Allow /ads.txt

jorgee

Rule Path
Disallow /
Allow /ads.txt

justview

Rule Path
Disallow /
Allow /ads.txt

jyxobot

Rule Path
Disallow /
Allow /ads.txt

kenjin spider

Rule Path
Disallow /
Allow /ads.txt

keybot translation-search-machine

Rule Path
Disallow /
Allow /ads.txt

keyword density

Rule Path
Disallow /
Allow /ads.txt

kinza

Rule Path
Disallow /
Allow /ads.txt

kozmosbot

Rule Path
Disallow /
Allow /ads.txt

lnspiderguy

Rule Path
Disallow /
Allow /ads.txt

lwp::simple

Rule Path
Disallow /
Allow /ads.txt

lanshanbot

Rule Path
Disallow /
Allow /ads.txt

larbin

Rule Path
Disallow /
Allow /ads.txt

leap

Rule Path
Disallow /
Allow /ads.txt

leechftp

Rule Path
Disallow /
Allow /ads.txt

leechget

Rule Path
Disallow /
Allow /ads.txt

lexibot

Rule Path
Disallow /
Allow /ads.txt

lftp

Rule Path
Disallow /
Allow /ads.txt

libweb

Rule Path
Disallow /
Allow /ads.txt

libwhisker

Rule Path
Disallow /
Allow /ads.txt

liebaofast

Rule Path
Disallow /
Allow /ads.txt

lightspeedsystems

Rule Path
Disallow /
Allow /ads.txt

likse

Rule Path
Disallow /
Allow /ads.txt

linkscan

Rule Path
Disallow /
Allow /ads.txt

linkwalker

Rule Path
Disallow /
Allow /ads.txt

linkbot

Rule Path
Disallow /
Allow /ads.txt

linkextractorpro

Rule Path
Disallow /
Allow /ads.txt

linkpadbot

Rule Path
Disallow /
Allow /ads.txt

linksmanager

Rule Path
Disallow /
Allow /ads.txt

linqiametadatadownloaderbot

Rule Path
Disallow /
Allow /ads.txt

linqiarssbot

Rule Path
Disallow /
Allow /ads.txt

linqiascrapebot

Rule Path
Disallow /
Allow /ads.txt

lipperhey

Rule Path
Disallow /
Allow /ads.txt

lipperhey spider

Rule Path
Disallow /
Allow /ads.txt

litemage_walker

Rule Path
Disallow /
Allow /ads.txt

lmspider

Rule Path
Disallow /
Allow /ads.txt

ltx71

Rule Path
Disallow /
Allow /ads.txt

mfc_tear_sample

Rule Path
Disallow /
Allow /ads.txt

midown tool

Rule Path
Disallow /
Allow /ads.txt

miixpc

Rule Path
Disallow /
Allow /ads.txt

mj12bot

Rule Path
Disallow /
Allow /ads.txt

mqqbrowser

Rule Path
Disallow /
Allow /ads.txt

msfrontpage

Rule Path
Disallow /
Allow /ads.txt

msiecrawler

Rule Path
Disallow /
Allow /ads.txt

mtrobot

Rule Path
Disallow /
Allow /ads.txt

mag-net

Rule Path
Disallow /
Allow /ads.txt

magnet

Rule Path
Disallow /
Allow /ads.txt

mail.ru_bot

Rule Path
Disallow /
Allow /ads.txt

majestic-seo

Rule Path
Disallow /
Allow /ads.txt

majestic12

Rule Path
Disallow /
Allow /ads.txt

majestic seo

Rule Path
Disallow /
Allow /ads.txt

markmonitor

Rule Path
Disallow /
Allow /ads.txt

markwatch

Rule Path
Disallow /
Allow /ads.txt

mass downloader

Rule Path
Disallow /
Allow /ads.txt

masscan

Rule Path
Disallow /
Allow /ads.txt

mata hari

Rule Path
Disallow /
Allow /ads.txt

mauibot

Rule Path
Disallow /
Allow /ads.txt

mb2345browser

Rule Path
Disallow /
Allow /ads.txt

meanpath bot

Rule Path
Disallow /
Allow /ads.txt

meanpathbot

Rule Path
Disallow /
Allow /ads.txt

mediatoolkitbot

Rule Path
Disallow /
Allow /ads.txt

megaindex.ru

Rule Path
Disallow /
Allow /ads.txt

metauri

Rule Path
Disallow /
Allow /ads.txt

micromessenger

Rule Path
Disallow /
Allow /ads.txt

microsoft url control

Rule Path
Disallow /
Allow /ads.txt

minefield

Rule Path
Disallow /
Allow /ads.txt

mister pix

Rule Path
Disallow /
Allow /ads.txt

moblie safari

Rule Path
Disallow /
Allow /ads.txt

mojeek

Rule Path
Disallow /
Allow /ads.txt

mojolicious

Rule Path
Disallow /
Allow /ads.txt

molokaibot

Rule Path
Disallow /
Allow /ads.txt

morfeus fucking scanner

Rule Path
Disallow /
Allow /ads.txt

mozlila

Rule Path
Disallow /
Allow /ads.txt

mr.4x3

Rule Path
Disallow /
Allow /ads.txt

msrabot

Rule Path
Disallow /
Allow /ads.txt

musobot

Rule Path
Disallow /
Allow /ads.txt

nicerspro

Rule Path
Disallow /
Allow /ads.txt

npbot

Rule Path
Disallow /
Allow /ads.txt

name intelligence

Rule Path
Disallow /
Allow /ads.txt

nameprotect

Rule Path
Disallow /
Allow /ads.txt

navroad

Rule Path
Disallow /
Allow /ads.txt

nearsite

Rule Path
Disallow /
Allow /ads.txt

needle

Rule Path
Disallow /
Allow /ads.txt

nessus

Rule Path
Disallow /
Allow /ads.txt

netants

Rule Path
Disallow /
Allow /ads.txt

netlyzer

Rule Path
Disallow /
Allow /ads.txt

netmechanic

Rule Path
Disallow /
Allow /ads.txt

netspider

Rule Path
Disallow /
Allow /ads.txt

netzip

Rule Path
Disallow /
Allow /ads.txt

net vampire

Rule Path
Disallow /
Allow /ads.txt

netcraft

Rule Path
Disallow /
Allow /ads.txt

nettrack

Rule Path
Disallow /
Allow /ads.txt

netvibes

Rule Path
Disallow /
Allow /ads.txt

nextgensearchbot

Rule Path
Disallow /
Allow /ads.txt

nibbler

Rule Path
Disallow /
Allow /ads.txt

niki-bot

Rule Path
Disallow /
Allow /ads.txt

nikto

Rule Path
Disallow /
Allow /ads.txt

nimblecrawler

Rule Path
Disallow /
Allow /ads.txt

nimbostratus

Rule Path
Disallow /
Allow /ads.txt

ninja

Rule Path
Disallow /
Allow /ads.txt

nmap

Rule Path
Disallow /
Allow /ads.txt

not

Rule Path
Disallow /
Allow /ads.txt

nuclei

Rule Path
Disallow /
Allow /ads.txt

nutch

Rule Path
Disallow /
Allow /ads.txt

octopus

Rule Path
Disallow /
Allow /ads.txt

offline explorer

Rule Path
Disallow /
Allow /ads.txt

offline navigator

Rule Path
Disallow /
Allow /ads.txt

oncrawl

Rule Path
Disallow /
Allow /ads.txt

openlinkprofiler

Rule Path
Disallow /
Allow /ads.txt

openvas

Rule Path
Disallow /
Allow /ads.txt

openfind

Rule Path
Disallow /
Allow /ads.txt

openvas

Rule Path
Disallow /
Allow /ads.txt

orangebot

Rule Path
Disallow /
Allow /ads.txt

orangespider

Rule Path
Disallow /
Allow /ads.txt

outclicksbot

Rule Path
Disallow /
Allow /ads.txt

outfoxbot

Rule Path
Disallow /
Allow /ads.txt

pecl::http

Rule Path
Disallow /
Allow /ads.txt

phpcrawl

Rule Path
Disallow /
Allow /ads.txt

poe-component-client-http

Rule Path
Disallow /
Allow /ads.txt

pageanalyzer

Rule Path
Disallow /
Allow /ads.txt

pagegrabber

Rule Path
Disallow /
Allow /ads.txt

pagescorer

Rule Path
Disallow /
Allow /ads.txt

pagething.com

Rule Path
Disallow /
Allow /ads.txt

page analyzer

Rule Path
Disallow /
Allow /ads.txt

pandalytics

Rule Path
Disallow /
Allow /ads.txt

panscient

Rule Path
Disallow /
Allow /ads.txt

papa foto

Rule Path
Disallow /
Allow /ads.txt

pavuk

Rule Path
Disallow /
Allow /ads.txt

peoplepal

Rule Path
Disallow /
Allow /ads.txt

petalbot

Rule Path
Disallow /
Allow /ads.txt

pi-monster

Rule Path
Disallow /
Allow /ads.txt

picscout

Rule Path
Disallow /
Allow /ads.txt

picsearch

Rule Path
Disallow /
Allow /ads.txt

picturefinder

Rule Path
Disallow /
Allow /ads.txt

piepmatz

Rule Path
Disallow /
Allow /ads.txt

pimonster

Rule Path
Disallow /
Allow /ads.txt

pixray

Rule Path
Disallow /
Allow /ads.txt

pleasecrawl

Rule Path
Disallow /
Allow /ads.txt

pockey

Rule Path
Disallow /
Allow /ads.txt

propowerbot

Rule Path
Disallow /
Allow /ads.txt

prowebwalker

Rule Path
Disallow /
Allow /ads.txt

probethenet

Rule Path
Disallow /
Allow /ads.txt

psbot

Rule Path
Disallow /
Allow /ads.txt

pu_in

Rule Path
Disallow /
Allow /ads.txt

pump

Rule Path
Disallow /
Allow /ads.txt

pxbroker

Rule Path
Disallow /
Allow /ads.txt

pycurl

Rule Path
Disallow /
Allow /ads.txt

queryn metasearch

Rule Path
Disallow /
Allow /ads.txt

quick-crawler

Rule Path
Disallow /
Allow /ads.txt

rssingbot

Rule Path
Disallow /
Allow /ads.txt

rankactive

Rule Path
Disallow /
Allow /ads.txt

rankactivelinkbot

Rule Path
Disallow /
Allow /ads.txt

rankflex

Rule Path
Disallow /
Allow /ads.txt

rankingbot

Rule Path
Disallow /
Allow /ads.txt

rankingbot2

Rule Path
Disallow /
Allow /ads.txt

rankivabot

Rule Path
Disallow /
Allow /ads.txt

rankurbot

Rule Path
Disallow /
Allow /ads.txt

re-re

Rule Path
Disallow /
Allow /ads.txt

reget

Rule Path
Disallow /
Allow /ads.txt

realdownload

Rule Path
Disallow /
Allow /ads.txt

reaper

Rule Path
Disallow /
Allow /ads.txt

rebelmouse

Rule Path
Disallow /
Allow /ads.txt

recorder

Rule Path
Disallow /
Allow /ads.txt

redesscrapy

Rule Path
Disallow /
Allow /ads.txt

repomonkey

Rule Path
Disallow /
Allow /ads.txt

ripper

Rule Path
Disallow /
Allow /ads.txt

rocketcrawler

Rule Path
Disallow /
Allow /ads.txt

rogerbot

Rule Path
Disallow /
Allow /ads.txt

sbider

Rule Path
Disallow /
Allow /ads.txt

seokicks

Rule Path
Disallow /
Allow /ads.txt

seokicks-robot

Rule Path
Disallow /
Allow /ads.txt

seolyticscrawler

Rule Path
Disallow /
Allow /ads.txt

seoprofiler

Rule Path
Disallow /
Allow /ads.txt

seostats

Rule Path
Disallow /
Allow /ads.txt

smtbot

Rule Path
Disallow /
Allow /ads.txt

salesintelligent

Rule Path
Disallow /
Allow /ads.txt

scanalert

Rule Path
Disallow /
Allow /ads.txt

scanbot

Rule Path
Disallow /
Allow /ads.txt

scoutjet

Rule Path
Disallow /
Allow /ads.txt

scrapy

Rule Path
Disallow /
Allow /ads.txt

screaming

Rule Path
Disallow /
Allow /ads.txt

screenerbot

Rule Path
Disallow /
Allow /ads.txt

screpybot

Rule Path
Disallow /
Allow /ads.txt

searchestate

Rule Path
Disallow /
Allow /ads.txt

searchmetricsbot

Rule Path
Disallow /
Allow /ads.txt

seekport

Rule Path
Disallow /
Allow /ads.txt

semanticjuice

Rule Path
Disallow /
Allow /ads.txt

semrush

Rule Path
Disallow /
Allow /ads.txt

semrushbot

Rule Path
Disallow /
Allow /ads.txt

sentibot

Rule Path
Disallow /
Allow /ads.txt

seositecheckup

Rule Path
Disallow /
Allow /ads.txt

seobilitybot

Rule Path
Disallow /
Allow /ads.txt

seomoz

Rule Path
Disallow /
Allow /ads.txt

shodan

Rule Path
Disallow /
Allow /ads.txt

siphon

Rule Path
Disallow /
Allow /ads.txt

sitecheckerbotcrawler

Rule Path
Disallow /
Allow /ads.txt

siteexplorer

Rule Path
Disallow /
Allow /ads.txt

sitelockspider

Rule Path
Disallow /
Allow /ads.txt

sitesnagger

Rule Path
Disallow /
Allow /ads.txt

sitesucker

Rule Path
Disallow /
Allow /ads.txt

site sucker

Rule Path
Disallow /
Allow /ads.txt

sitebeam

Rule Path
Disallow /
Allow /ads.txt

siteimprove

Rule Path
Disallow /
Allow /ads.txt

sitevigil

Rule Path
Disallow /
Allow /ads.txt

slysearch

Rule Path
Disallow /
Allow /ads.txt

smartdownload

Rule Path
Disallow /
Allow /ads.txt

snake

Rule Path
Disallow /
Allow /ads.txt

snapbot

Rule Path
Disallow /
Allow /ads.txt

snoopy

Rule Path
Disallow /
Allow /ads.txt

socialrankiobot

Rule Path
Disallow /
Allow /ads.txt

sociscraper

Rule Path
Disallow /
Allow /ads.txt

sogou web spider

Rule Path
Disallow /
Allow /ads.txt

sosospider

Rule Path
Disallow /
Allow /ads.txt

sottopop

Rule Path
Disallow /
Allow /ads.txt

spacebison

Rule Path
Disallow /
Allow /ads.txt

spammen

Rule Path
Disallow /
Allow /ads.txt

spankbot

Rule Path
Disallow /
Allow /ads.txt

spanner

Rule Path
Disallow /
Allow /ads.txt

spbot

Rule Path
Disallow /
Allow /ads.txt

spinn3r

Rule Path
Disallow /
Allow /ads.txt

sputnikbot

Rule Path
Disallow /
Allow /ads.txt

sqlmap

Rule Path
Disallow /
Allow /ads.txt

sqlworm

Rule Path
Disallow /
Allow /ads.txt

sqworm

Rule Path
Disallow /
Allow /ads.txt

steeler

Rule Path
Disallow /
Allow /ads.txt

stripper

Rule Path
Disallow /
Allow /ads.txt

sucker

Rule Path
Disallow /
Allow /ads.txt

sucuri

Rule Path
Disallow /
Allow /ads.txt

superbot

Rule Path
Disallow /
Allow /ads.txt

superhttp

Rule Path
Disallow /
Allow /ads.txt

surfbot

Rule Path
Disallow /
Allow /ads.txt

surveybot

Rule Path
Disallow /
Allow /ads.txt

suzuran

Rule Path
Disallow /
Allow /ads.txt

swiftbot

Rule Path
Disallow /
Allow /ads.txt

szukacz

Rule Path
Disallow /
Allow /ads.txt

t0phackteam

Rule Path
Disallow /
Allow /ads.txt

t8abot

Rule Path
Disallow /
Allow /ads.txt

teleport

Rule Path
Disallow /
Allow /ads.txt

teleportpro

Rule Path
Disallow /
Allow /ads.txt

telesoft

Rule Path
Disallow /
Allow /ads.txt

telesphoreo

Rule Path
Disallow /
Allow /ads.txt

telesphorep

Rule Path
Disallow /
Allow /ads.txt

thenomad

Rule Path
Disallow /
Allow /ads.txt

the intraformant

Rule Path
Disallow /
Allow /ads.txt

thumbor

Rule Path
Disallow /
Allow /ads.txt

tighttwatbot

Rule Path
Disallow /
Allow /ads.txt

titan

Rule Path
Disallow /
Allow /ads.txt

toata

Rule Path
Disallow /
Allow /ads.txt

toweyabot

Rule Path
Disallow /
Allow /ads.txt

tracemyfile

Rule Path
Disallow /
Allow /ads.txt

trendiction

Rule Path
Disallow /
Allow /ads.txt

trendictionbot

Rule Path
Disallow /
Allow /ads.txt

true_robot

Rule Path
Disallow /
Allow /ads.txt

turingos

Rule Path
Disallow /
Allow /ads.txt

turnitin

Rule Path
Disallow /
Allow /ads.txt

turnitinbot

Rule Path
Disallow /
Allow /ads.txt

twengabot

Rule Path
Disallow /
Allow /ads.txt

twice

Rule Path
Disallow /
Allow /ads.txt

typhoeus

Rule Path
Disallow /
Allow /ads.txt

urly.warning

Rule Path
Disallow /
Allow /ads.txt

urly warning

Rule Path
Disallow /
Allow /ads.txt

unisterbot

Rule Path
Disallow /
Allow /ads.txt

upflow

Rule Path
Disallow /
Allow /ads.txt

v-bot

Rule Path
Disallow /
Allow /ads.txt

vb project

Rule Path
Disallow /
Allow /ads.txt

vci

Rule Path
Disallow /
Allow /ads.txt

vacuum

Rule Path
Disallow /
Allow /ads.txt

vagabondo

Rule Path
Disallow /
Allow /ads.txt

velenpublicwebcrawler

Rule Path
Disallow /
Allow /ads.txt

vericitecrawler

Rule Path
Disallow /
Allow /ads.txt

vidiblescraper

Rule Path
Disallow /
Allow /ads.txt

virusdie

Rule Path
Disallow /
Allow /ads.txt

voideye

Rule Path
Disallow /
Allow /ads.txt

voil

Rule Path
Disallow /
Allow /ads.txt

voltron

Rule Path
Disallow /
Allow /ads.txt

wasalive-bot

Rule Path
Disallow /
Allow /ads.txt

wbsearchbot

Rule Path
Disallow /
Allow /ads.txt

webdav

Rule Path
Disallow /
Allow /ads.txt

wisenutbot

Rule Path
Disallow /
Allow /ads.txt

wpscan

Rule Path
Disallow /
Allow /ads.txt

www-collector-e

Rule Path
Disallow /
Allow /ads.txt

www-mechanize

Rule Path
Disallow /
Allow /ads.txt

www::mechanize

Rule Path
Disallow /
Allow /ads.txt

wwwoffle

Rule Path
Disallow /
Allow /ads.txt

wallpapers

Rule Path
Disallow /
Allow /ads.txt

wallpapers/3.0

Rule Path
Disallow /
Allow /ads.txt

wallpapershd

Rule Path
Disallow /
Allow /ads.txt

wesee

Rule Path
Disallow /
Allow /ads.txt

webauto

Rule Path
Disallow /
Allow /ads.txt

webbandit

Rule Path
Disallow /
Allow /ads.txt

webcollage

Rule Path
Disallow /
Allow /ads.txt

webcopier

Rule Path
Disallow /
Allow /ads.txt

webenhancer

Rule Path
Disallow /
Allow /ads.txt

webfetch

Rule Path
Disallow /
Allow /ads.txt

webfuck

Rule Path
Disallow /
Allow /ads.txt

webgo is

Rule Path
Disallow /
Allow /ads.txt

webimagecollector

Rule Path
Disallow /
Allow /ads.txt

webleacher

Rule Path
Disallow /
Allow /ads.txt

webpix

Rule Path
Disallow /
Allow /ads.txt

webreaper

Rule Path
Disallow /
Allow /ads.txt

websauger

Rule Path
Disallow /
Allow /ads.txt

webstripper

Rule Path
Disallow /
Allow /ads.txt

websucker

Rule Path
Disallow /
Allow /ads.txt

webwhacker

Rule Path
Disallow /
Allow /ads.txt

webzip

Rule Path
Disallow /
Allow /ads.txt

web auto

Rule Path
Disallow /
Allow /ads.txt

web collage

Rule Path
Disallow /
Allow /ads.txt

web enhancer

Rule Path
Disallow /
Allow /ads.txt

web fetch

Rule Path
Disallow /
Allow /ads.txt

web fuck

Rule Path
Disallow /
Allow /ads.txt

web pix

Rule Path
Disallow /
Allow /ads.txt

web sauger

Rule Path
Disallow /
Allow /ads.txt

web sucker

Rule Path
Disallow /
Allow /ads.txt

webalta

Rule Path
Disallow /
Allow /ads.txt

webmasterworldforumbot

Rule Path
Disallow /
Allow /ads.txt

webshag

Rule Path
Disallow /
Allow /ads.txt

websiteextractor

Rule Path
Disallow /
Allow /ads.txt

websitequester

Rule Path
Disallow /
Allow /ads.txt

website quester

Rule Path
Disallow /
Allow /ads.txt

webster

Rule Path
Disallow /
Allow /ads.txt

whack

Rule Path
Disallow /
Allow /ads.txt

whacker

Rule Path
Disallow /
Allow /ads.txt

whatweb

Rule Path
Disallow /
Allow /ads.txt

who.is bot

Rule Path
Disallow /
Allow /ads.txt

widow

Rule Path
Disallow /
Allow /ads.txt

winhttrack

Rule Path
Disallow /
Allow /ads.txt

wiseguys robot

Rule Path
Disallow /
Allow /ads.txt

wonderbot

Rule Path
Disallow /
Allow /ads.txt

woobot

Rule Path
Disallow /
Allow /ads.txt

wotbox

Rule Path
Disallow /
Allow /ads.txt

wprecon

Rule Path
Disallow /
Allow /ads.txt

xaldon webspider

Rule Path
Disallow /
Allow /ads.txt

xaldon_webspider

Rule Path
Disallow /
Allow /ads.txt

xenu

Rule Path
Disallow /
Allow /ads.txt

youdaobot

Rule Path
Disallow /
Allow /ads.txt

zade

Rule Path
Disallow /
Allow /ads.txt

zauba

Rule Path
Disallow /
Allow /ads.txt

zermelo

Rule Path
Disallow /
Allow /ads.txt

zeus

Rule Path
Disallow /
Allow /ads.txt

zitebot

Rule Path
Disallow /
Allow /ads.txt

zmeu

Rule Path
Disallow /
Allow /ads.txt

zoombot

Rule Path
Disallow /
Allow /ads.txt

zoominfobot

Rule Path
Disallow /
Allow /ads.txt

zumbot

Rule Path
Disallow /
Allow /ads.txt

zyborg

Rule Path
Disallow /
Allow /ads.txt

adscanner

Rule Path
Disallow /
Allow /ads.txt

archive.org_bot

Rule Path
Disallow /
Allow /ads.txt

arquivo-web-crawler

Rule Path
Disallow /
Allow /ads.txt

arquivo.pt

Rule Path
Disallow /
Allow /ads.txt

autoemailspider

Rule Path
Disallow /
Allow /ads.txt

backlink-check

Rule Path
Disallow /
Allow /ads.txt

cah.io.community

Rule Path
Disallow /
Allow /ads.txt

check1.exe

Rule Path
Disallow /
Allow /ads.txt

clark-crawler

Rule Path
Disallow /
Allow /ads.txt

coccocbot

Rule Path
Disallow /
Allow /ads.txt

cognitiveseo

Rule Path
Disallow /
Allow /ads.txt

com.plumanalytics

Rule Path
Disallow /
Allow /ads.txt

crawl.sogou.com

Rule Path
Disallow /
Allow /ads.txt

crawler.feedback

Rule Path
Disallow /
Allow /ads.txt

crawler4j

Rule Path
Disallow /
Allow /ads.txt

dataforseo.com

Rule Path
Disallow /
Allow /ads.txt

demandbase-bot

Rule Path
Disallow /
Allow /ads.txt

domainsproject.org

Rule Path
Disallow /
Allow /ads.txt

ecatch

Rule Path
Disallow /
Allow /ads.txt

evc-batch

Rule Path
Disallow /
Allow /ads.txt

facebookscraper

Rule Path
Disallow /
Allow /ads.txt

gopher

Rule Path
Disallow /
Allow /ads.txt

heritrix

Rule Path
Disallow /
Allow /ads.txt

instabid

Rule Path
Disallow /
Allow /ads.txt

internetvista monitor

Rule Path
Disallow /
Allow /ads.txt

ips-agent

Rule Path
Disallow /
Allow /ads.txt

isitwp.com

Rule Path
Disallow /
Allow /ads.txt

iubenda-radar

Rule Path
Disallow /
Allow /ads.txt

linkdexbot

Rule Path
Disallow /
Allow /ads.txt

lwp-request

Rule Path
Disallow /
Allow /ads.txt

lwp-trivial

Rule Path
Disallow /
Allow /ads.txt

magpie-crawler

Rule Path
Disallow /
Allow /ads.txt

meanpathbot

Rule Path
Disallow /
Allow /ads.txt

mediawords

Rule Path
Disallow /
Allow /ads.txt

muhstik-scan

Rule Path
Disallow /
Allow /ads.txt

netestate ne crawler

Rule Path
Disallow /
Allow /ads.txt

obot

Rule Path
Disallow /
Allow /ads.txt

page scorer

Rule Path
Disallow /
Allow /ads.txt

pcbrowser

Rule Path
Disallow /
Allow /ads.txt

plumanalytics

Rule Path
Disallow /
Allow /ads.txt

polaris version

Rule Path
Disallow /
Allow /ads.txt

probe-image-size

Rule Path
Disallow /
Allow /ads.txt

ripz

Rule Path
Disallow /
Allow /ads.txt

s1z.ru

Rule Path
Disallow /
Allow /ads.txt

satoristudio.net

Rule Path
Disallow /
Allow /ads.txt

scalaj-http

Rule Path
Disallow /
Allow /ads.txt

scan.lol

Rule Path
Disallow /
Allow /ads.txt

seobility

Rule Path
Disallow /
Allow /ads.txt

seocompany.store

Rule Path
Disallow /
Allow /ads.txt

seoscanners

Rule Path
Disallow /
Allow /ads.txt

seostar

Rule Path
Disallow /
Allow /ads.txt

serpstatbot

Rule Path
Disallow /
Allow /ads.txt

sexsearcher

Rule Path
Disallow /
Allow /ads.txt

sitechecker.pro

Rule Path
Disallow /
Allow /ads.txt

siteripz

Rule Path
Disallow /
Allow /ads.txt

sogouspider

Rule Path
Disallow /
Allow /ads.txt

sp_auditbot

Rule Path
Disallow /
Allow /ads.txt

spyfu

Rule Path
Disallow /
Allow /ads.txt

sysscan

Rule Path
Disallow /
Allow /ads.txt

takeout

Rule Path
Disallow /
Allow /ads.txt

trendiction.com

Rule Path
Disallow /
Allow /ads.txt

trendiction.de

Rule Path
Disallow /
Allow /ads.txt

ubermetrics-technologies.com

Rule Path
Disallow /
Allow /ads.txt

voyagerx.com

Rule Path
Disallow /
Allow /ads.txt

webgains-bot

Rule Path
Disallow /
Allow /ads.txt

webmeup-crawler

Rule Path
Disallow /
Allow /ads.txt

webpros.com

Rule Path
Disallow /
Allow /ads.txt

webprosbot

Rule Path
Disallow /
Allow /ads.txt

x09mozilla

Rule Path
Disallow /
Allow /ads.txt

x22mozilla

Rule Path
Disallow /
Allow /ads.txt

xpymep1.exe

Rule Path
Disallow /
Allow /ads.txt

zauba.io

Rule Path
Disallow /
Allow /ads.txt

zgrab

Rule Path
Disallow /
Allow /ads.txt

sentibot

Rule Path
Disallow /
Allow /ads.txt

chatgpt-user

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.autokostencheck.de/sitemap_index.xml
sitemap https://www.autokostencheck.de/sitemap_1.xml
sitemap https://www.autokostencheck.de/sitemap_2.xml
sitemap https://www.autokostencheck.de/sitemap_3.xml
sitemap https://www.autokostencheck.de/sitemap_4.xml
sitemap https://www.autokostencheck.de/sitemap_5.xml
sitemap https://www.autokostencheck.de/sitemap_6.xml
sitemap https://www.autokostencheck.de/sitemap_7.xml
sitemap https://www.autokostencheck.de/sitemap_8.xml
sitemap https://www.autokostencheck.de/sitemap_9.xml
sitemap https://www.autokostencheck.de/sitemap_10.xml
sitemap https://www.autokostencheck.de/sitemap_11.xml
sitemap https://www.autokostencheck.de/sitemap_13.xml
Back to top

Comments

  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • User-agent: SISTRIX
  • Disallow: /
  • Allow: /ads.txt
  • Intrusive bot
  • AI Bots
Back to top

Warnings

  • 15 invalid lines.
Back to top