Log In Sign Up

2ys.eu
robots.txt

Robots Exclusion Standard data for 2ys.eu

Resource Scan

Scan Details

Site Domain 2ys.eu
Base Domain 2ys.eu
Scan Status Ok
Last Scan2024-06-18T06:32:17+00:00
Next Scan 2024-06-25T06:32:17+00:00

Last Scan

Scanned2024-06-18T06:32:17+00:00
URL https://2ys.eu/robots.txt
Domain IPs 94.136.170.26
Response IP 94.136.170.26
Found Yes
Hash 6d6e4cc56bdb4871d92fd4759223feaa0c55985831ec857a4f1886bd4310fd5b
SimHash 58566ff058e3

Groups

*

Rule Path
Disallow /rss.php*
Disallow /admin
Disallow *articles/article-*

aboundexbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

betabot

Rule Path
Disallow /

bigbozz

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

comodospider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

daum

Rule Path
Disallow /

deusu

Rule Path
Disallow /

discoveryengine

Rule Path
Disallow /

domainappender

Rule Path
Disallow /

domainreanimator

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

finbot

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

getintentcrawler

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

iskanie

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkwalker/3.0

Rule Path
Disallow /

linqiarssbot

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

morfeus fucking scanner

Rule Path
Disallow /

musobot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

panelbot

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ptd-crawler

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

riddler

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seplinkbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

snk screenshot bot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

tbot-nutch

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

veoozbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wpspider

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

yoozbot-2.2

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.gateuk.com/sitemaps/index.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top