birimdonusturucu.com
robots.txt

Robots Exclusion Standard data for birimdonusturucu.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	birimdonusturucu.com
Base Domain	birimdonusturucu.com
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2025-10-01T15:19:53+00:00
Next Scan	2025-12-30T15:19:53+00:00

Last Successful Scan

Scanned	2022-06-04T18:29:17+00:00
URL	https://birimdonusturucu.com/robots.txt
Response IP	45.88.151.242
Found	Yes
Hash	2975c289049f09003edcd3340a56736a24f0a23d15eb9e0e36d0bd7f2f352ffe
SimHash	5c54dc425483

Groups

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

teoma

Rule	Path
Disallow	/

Rule

Path

Disallow

swiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

easouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

yyspider

Rule	Path
Disallow	/

Rule

Path

Disallow

flightdeckreports bot

Rule	Path
Disallow	/

Rule

Path

Disallow

linguee bot

Rule	Path
Disallow	/

Rule

Path

Disallow

twiceler

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrubby

Rule	Path
Disallow	/

Rule

Path

Disallow

robozilla

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

naverbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yeti

Rule	Path
Disallow	/

Rule

Path

Disallow

psbot

Rule	Path
Disallow	/

Rule

Path

Disallow

asterias

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

yodaobot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

uptimebot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

extlinksbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aihitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

researchscan

Rule	Path
Disallow	/

Rule

Path

Disallow

dnyzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

metajobbot

Rule	Path
Disallow	/

Rule

Path

Disallow

komodiabot

Rule	Path
Disallow	/

Rule

Path

Disallow

gecko

Rule	Path
Disallow	/

Rule

Path

Disallow

obot

Rule	Path
Disallow	/

Rule

Path

Disallow

neevabot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

duckduckbot

Rule	Path
Disallow	/

Rule

Path

Disallow

krzana+bot

Rule	Path
Disallow	/

Rule

Path

Disallow

smtbot

Rule

Path

Disallow

mrgbot

Rule

Path

Disallow

*

Rule

Path

Disallow

/css/

Disallow

/gucheng/cacheDate/

Disallow

/google.js

Warnings

2 invalid lines.

birimdonusturucu.comrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

msnbot

slurp

teoma

swiftbot

easouspider

yyspider

flightdeckreports bot

linguee bot

twiceler

gigabot

scrubby

robozilla

nutch

ia_archiver

baiduspider

naverbot

yeti

psbot

asterias

sosospider

sogou spider

yisouspider

bytespider

yodaobot

coccocbot

ahrefsbot

dotbot

uptimebot

mj12bot

megaindex.ru

zoominfobot

mail.ru

seznambot

blexbot

extlinksbot

aihitbot

researchscan

dnyzbot

spbot

yandexbot

metajobbot

komodiabot

gecko

obot

neevabot

semrushbot

duckduckbot

krzana+bot

smtbot

mrgbot

*

Warnings

birimdonusturucu.com
robots.txt