Log In Sign Up

adanahaber.web.tr
robots.txt

Robots Exclusion Standard data for adanahaber.web.tr

Resource Scan

Scan Details

Site Domain adanahaber.web.tr
Base Domain adanahaber.web.tr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-27T00:21:49+00:00
Next Scan 2024-10-04T00:21:49+00:00

Last Successful Scan

Scanned2024-09-19T00:15:59+00:00
URL https://adanahaber.web.tr/robots.txt
Domain IPs 213.238.180.223
Response IP 213.238.180.223
Found Yes
Hash b141b6cae23bea18334fcbcf11bff06727701682b44914b2bdb81894de5b8cdd
SimHash f39f537a4fc5

Groups

asterias

Rule Path
Disallow

backdoorbot/1.0

Rule Path
Disallow

black hole

Rule Path
Disallow

blowfish/1.0

Rule Path
Disallow

botalot

Rule Path
Disallow

builtbottough

Rule Path
Disallow

bullseye/1.0

Rule Path
Disallow

bunnyslippers

Rule Path
Disallow

cegbfeieh

Rule Path
Disallow

cheesebot

Rule Path
Disallow

cherrypicker

Rule Path
Disallow

cherrypickerelite/1.0

Rule Path
Disallow

cherrypickerse/1.0

Rule Path
Disallow

copyrightcheck

Rule Path
Disallow

cosmos

Rule Path
Disallow

crescent

Rule Path
Disallow

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow

dittospyder

Rule Path
Disallow

emailcollector

Rule Path
Disallow

emailsiphon

Rule Path
Disallow

emailwolf

Rule Path
Disallow

erocrawler

Rule Path
Disallow

extractorpro

Rule Path
Disallow

foobot

Rule Path
Disallow

googlebot

Rule Path
Disallow

gezginbot

Rule Path
Disallow

harvest/1.5

Rule Path
Disallow

hloader

Rule Path
Disallow

httplib

Rule Path
Disallow

humanlinks

Rule Path
Disallow

infonavirobot

Rule Path
Disallow

jennybot

Rule Path
Disallow

kenjin spider

Rule Path
Disallow

keyword density/0.9

Rule Path
Disallow

lexibot

Rule Path
Disallow

libweb/clshttp

Rule Path
Disallow

linkextractorpro

Rule Path
Disallow

linkscan/8.1a unix

Rule Path
Disallow

linkwalker

Rule Path
Disallow

lnspiderguy

Rule Path
Disallow

lwp-trivial

Rule Path
Disallow

lwp-trivial/1.34

Rule Path
Disallow

mata hari

Rule Path
Disallow

microsoft url control - 5.01.4511

Rule Path
Disallow

microsoft url control - 6.00.8169

Rule Path
Disallow

miixpc

Rule Path
Disallow

miixpc/4.2

Rule Path
Disallow

mister pix

Rule Path
Disallow

moget

Rule Path
Disallow

moget/2.1

Rule Path
Disallow

mozilla/4

Rule Path
Disallow

mozilla/4.0 (compatible; bullseye; windows 95)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows 95)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows 98)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows nt)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows xp)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows 2000)

Rule Path
Disallow

mozilla/4.0 (compatible; msie 4.0; windows me)

Rule Path
Disallow

mozilla/5

Rule Path
Disallow

netants

Rule Path
Disallow

nicerspro

Rule Path
Disallow

offline explorer

Rule Path
Disallow

openfind

Rule Path
Disallow

openfind data gathere

Rule Path
Disallow

propowerbot/2.14

Rule Path
Disallow

prowebwalker

Rule Path
Disallow

queryn ****search

Rule Path
Disallow

repomonkey

Rule Path
Disallow

repomonkey bait & tackle/v1.01

Rule Path
Disallow

rma

Rule Path
Disallow

sitesnagger

Rule Path
Disallow

spankbot

Rule Path
Disallow

spanner

Rule Path
Disallow

suzuran

Rule Path
Disallow

szukacz/1.4

Rule Path
Disallow

teleport

Rule Path
Disallow

teleportpro

Rule Path
Disallow

telesoft

Rule Path
Disallow

the intraformant

Rule Path
Disallow

thenomad

Rule Path
Disallow

tighttwatbot

Rule Path
Disallow

titan

Rule Path
Disallow

tocrawl/urldispatcher

Rule Path
Disallow

true_robot

Rule Path
Disallow

true_robot/1.0

Rule Path
Disallow

turingos

Rule Path
Disallow

urly warning

Rule Path
Disallow

vci

Rule Path
Disallow

vci webviewer vci webviewer win32

Rule Path
Disallow

web image collector

Rule Path
Disallow

webauto

Rule Path
Disallow

webbandit

Rule Path
Disallow

webbandit/3.50

Rule Path
Disallow

webcopier

Rule Path
Disallow

webenhancer

Rule Path
Disallow

webmasterworldforumbot

Rule Path
Disallow

websauger

Rule Path
Disallow

website quester

Rule Path
Disallow

webster pro

Rule Path
Disallow

webstripper

Rule Path
Disallow

webzip

Rule Path
Disallow

webzip/4.0

Rule Path
Disallow

wget

Rule Path
Disallow

wget/1.5.3

Rule Path
Disallow

wget/1.6

Rule Path
Disallow

www-collector-e

Rule Path
Disallow

xenu's

Rule Path
Disallow

xenu's link sleuth 1.1c

Rule Path
Disallow

zeus

Rule Path
Disallow

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow
Disallow /wp-content/
Disallow /trackback/
Disallow /wp-admin/
Disallow /archives/
Disallow /index.php
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$
Disallow */feed/
Disallow */trackback/

googlebot-image

Rule Path
Disallow /wp-includes/

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /
Back to top

Comments

  • robots.txt generated by https://sporblog.xyz robot generator
  • Please, we do NOT allow nonauthorized robots any longer.
Back to top