Log In Sign Up

dizifilmoyuncusu.com
robots.txt

Robots Exclusion Standard data for dizifilmoyuncusu.com

Resource Scan

Scan Details

Site Domain dizifilmoyuncusu.com
Base Domain dizifilmoyuncusu.com
Scan Status Ok
Last Scan2024-11-03T13:16:18+00:00
Next Scan 2024-12-03T13:16:18+00:00

Last Scan

Scanned2024-11-03T13:16:18+00:00
URL https://dizifilmoyuncusu.com/robots.txt
Domain IPs 89.252.134.131
Response IP 89.252.134.131
Found Yes
Hash 7c17c770fa5d2d8653fdc14a831eb24ff7c6140cc2526b1489625226a24cc20c
SimHash b4e2184b8aa3

Groups

adbeat_bot

Rule Path
Disallow /

agentlinkspammer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

aihitbot/1.0

Rule Path
Disallow /

aihitbot/1.1

Rule Path
Disallow /

androiddownloadmanager

Rule Path
Disallow /

arachmo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /

mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

cb/nutch

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

comodospider/nutch-1.2

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

exalead

Rule Path
Disallow /

exalead crawler

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot[at]gmail[dot]com)

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

ichiro 3.0

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

java/1.6.0_04

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

moget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netcraftsurveyagent/1.0

Rule Path
Disallow /

obot

Rule Path
Disallow /

openwebindex/nutch-1.6

Rule Path
Disallow /

openwebindex

Rule Path
Disallow /

panoptastudybot

Rule Path
Disallow /

checks.panopta.com

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

riddler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seznambot/1.1

Rule Path
Disallow /

seznambot/3.0

Rule Path
Disallow /

sistrixcrawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider+

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sosospider/2.0

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

synapse

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

youdaobot/1.0

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

wada.vn

Rule Path
Disallow /

wada.vn vietnamese search

Rule Path
Disallow /

wada.vn vietnamese search/2.1

Rule Path
Disallow /

zao

Rule Path
Disallow /

*

Rule Path
Disallow /oyuncu/basvuru/
Back to top

Other Records

Field Value
sitemap https://www.dizifilmoyuncusu.com/sitemapindex.xml
Back to top

Warnings

  • 8 invalid lines.
Back to top