kontologis.gr
robots.txt

Robots Exclusion Standard data for kontologis.gr

Resource Scan

Scan Details

Site Domain kontologis.gr
Base Domain kontologis.gr
Scan Status Ok
Last Scan2024-11-11T16:04:23+00:00
Next Scan 2024-11-18T16:04:23+00:00

Last Scan

Scanned2024-11-11T16:04:23+00:00
URL https://kontologis.gr/robots.txt
Domain IPs 104.21.72.231, 172.67.155.170, 2606:4700:3035::6815:48e7, 2606:4700:3037::ac43:9baa
Response IP 104.21.72.231
Found Yes
Hash e439b53f662da0bfaa10c9c35ce1c51d47ed4d094af41c72f8d6e080e2fce8d0
SimHash ca5cdce0ca70

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /articles/*/page/*
Disallow /tag/*/page/*
Disallow /page/*
Disallow /search/*

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

wasalive-bot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://kontologis.gr/sitemap_index.xml

Comments

  • BAD BOTS

Warnings

  • 2 invalid lines.