kaliningradfirst.ru
robots.txt

Robots Exclusion Standard data for kaliningradfirst.ru

Archived Snapshots

Resource Scan

Scan Details

Site Domain	kaliningradfirst.ru
Base Domain	kaliningradfirst.ru
Scan Status	Ok
Last Scan	2024-06-20T14:39:26+00:00
Next Scan	2024-06-27T14:39:26+00:00

Last Scan

Scanned	2024-06-20T14:39:26+00:00
URL	https://kaliningradfirst.ru/robots.txt
Domain IPs	95.217.18.13
Response IP	95.217.18.13
Found	Yes
Hash	7bbd07a1b6e1755d4addf7207f8dc149c81cf6d7e27ee818b09d00f181c5581e
SimHash	db2f74eaa6b0

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

uniplace-bot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

r6_commentreader

Rule	Path
Disallow	/

Rule

Path

Disallow

r6_feedfetcher

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

sputnikbot

Rule	Path
Disallow	/

Rule

Path

Disallow

kraken

Rule	Path
Disallow	/

Rule

Path

Disallow

kraken/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

Rule	Path
Disallow	/

Rule

Path

Disallow

arachnys/nutch-1.12

Rule	Path
Disallow	/

Rule

Path

Disallow

trendictionbot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy/1.2.2

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/fast/2.0; +http://go.mail.ru/help/robots)

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/kaliningradfirst.ru)

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler/3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

psbot

Rule	Path
Disallow	/

Rule

Path

Disallow

socredactorbot/1.2 (http://socredactor.ru; ; en-ru)

Rule	Path
Disallow	/

Rule

Path

Disallow

socredactorbot

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/wp-content/cache/
Disallow	/index.php?p=75018
Disallow	/?p=75018
Disallow	/index.php?p=66677
Disallow	/?p=66677
Disallow	/?p=110310
Disallow	/index.php?p=110310
Disallow	/index.php?p=134117
Disallow	/?p=134117
Disallow	/index.php?p=134286
Disallow	/?p=134286
Disallow	/?p=161944
Disallow	/index.php?p=161944
Disallow	/?p=163225
Disallow	/index.php?p=163225
Disallow	/?p=173016
Disallow	/index.php?p=173016
Disallow	/?p=174010
Disallow	/index.php?p=174010
Disallow	/?p=174419
Disallow	/index.php?p=174419
Disallow	/?p=174786
Disallow	/index.php?p=174786
Disallow	/?p=176005
Disallow	/index.php?p=176005
Disallow	/?p=175267
Disallow	/index.php?p=175267
Disallow	/?p=182110
Disallow	/index.php?p=182110
Disallow	/wstat
Disallow	/cgi-bin
Disallow	/wp-login.php
Disallow	/wp-admin/
Disallow	/wp-includes/
Disallow	/?author=*
Disallow	/193389
Disallow	/wp-json
Disallow	/wp-json/
Disallow	*/trackback/
Disallow	*/comments/
Disallow	/?s=
Disallow	/*p%3D
Disallow	/273820
Disallow	/273820/
Disallow	/278409/
Disallow	/278409
Disallow	/278626
Disallow	/278626/
Disallow	/278698/
Disallow	/278698
Disallow	/280515
Disallow	/280515/
Disallow	/286442
Disallow	/286442/
Disallow	/286657
Disallow	/286657/
Disallow	/289493
Disallow	/289493/
Disallow	/289893
Disallow	/289893/
Disallow	/292208
Disallow	/292208/
Disallow	/292986
Disallow	/292986/
Disallow	/293290
Disallow	/293290/
Disallow	/294833
Disallow	/294833/
Disallow	/295010/
Disallow	/297316
Disallow	/297316/
Disallow	/297676
Disallow	/297676/
Disallow	/298139
Disallow	/298139/
Disallow	/299245
Disallow	/299245/
Disallow	/299610
Disallow	/299610/
Disallow	/299893
Disallow	/299893/
Disallow	/300773
Disallow	/300773/
Disallow	/301137
Disallow	/301137/
Disallow	/306701
Disallow	/306701/
Disallow	/312891
Disallow	/312891/
Disallow	/319370
Disallow	/319370/
Disallow	/313871
Disallow	/313871/
Disallow	/316514
Disallow	/316514/
Disallow	/314707
Disallow	/314707/
Disallow	/321983
Disallow	/321983/
Disallow	/321897
Disallow	/321897/
Disallow	/321611
Disallow	/321611/
Disallow	/321546
Disallow	/321546/
Disallow	/321406
Disallow	/321406/
Disallow	/318488
Disallow	/318488/
Disallow	/321143
Disallow	/321143/
Disallow	/331214
Disallow	/331214/
Disallow	/327909
Disallow	/327909/
Disallow	/335378
Disallow	/335378/

Rule

Path

Disallow

/wp-content/cache/

Disallow

/index.php?p=75018

Disallow

/?p=75018

Disallow

/index.php?p=66677

Disallow

/?p=66677

Disallow

/?p=110310

Disallow

/index.php?p=110310

Disallow

/index.php?p=134117

Disallow

/?p=134117

Disallow

/index.php?p=134286

Disallow

/?p=134286

Disallow

/?p=161944

Disallow

/index.php?p=161944

Disallow

/?p=163225

Disallow

/index.php?p=163225

Disallow

/?p=173016

Disallow

/index.php?p=173016

Disallow

/?p=174010

Disallow

/index.php?p=174010

Disallow

/?p=174419

Disallow

/index.php?p=174419

Disallow

/?p=174786

Disallow

/index.php?p=174786

Disallow

/?p=176005

Disallow

/index.php?p=176005

Disallow

/?p=175267

Disallow

/index.php?p=175267

Disallow

/?p=182110

Disallow

/index.php?p=182110

Disallow

/wstat

Disallow

/cgi-bin

Disallow

/wp-login.php

Disallow

/wp-admin/

Disallow

/wp-includes/

Disallow

/?author=*

Disallow

/193389

Disallow

/wp-json

Disallow

/wp-json/

Disallow

*/trackback/

Disallow

*/comments/

Disallow

/?s=

Disallow

/*p%3D

Disallow

/273820

Disallow

/273820/

Disallow

/278409/

Disallow

/278409

Disallow

/278626

Disallow

/278626/

Disallow

/278698/

Disallow

/278698

Disallow

/280515

Disallow

/280515/

Disallow

/286442

Disallow

/286442/

Disallow

/286657

Disallow

/286657/

Disallow

/289493

Disallow

/289493/

Disallow

/289893

Disallow

/289893/

Disallow

/292208

Disallow

/292208/

Disallow

/292986

Disallow

/292986/

Disallow

/293290

Disallow

/293290/

Disallow

/294833

Disallow

/294833/

Disallow

/295010/

Disallow

/297316

Disallow

/297316/

Disallow

/297676

Disallow

/297676/

Disallow

/298139

Disallow

/298139/

Disallow

/299245

Disallow

/299245/

Disallow

/299610

Disallow

/299610/

Disallow

/299893

Disallow

/299893/

Disallow

/300773

Disallow

/300773/

Disallow

/301137

Disallow

/301137/

Disallow

/306701

Disallow

/306701/

Disallow

/312891

Disallow

/312891/

Disallow

/319370

Disallow

/319370/

Disallow

/313871

Disallow

/313871/

Disallow

/316514

Disallow

/316514/

Disallow

/314707

Disallow

/314707/

Disallow

/321983

Disallow

/321983/

Disallow

/321897

Disallow

/321897/

Disallow

/321611

Disallow

/321611/

Disallow

/321546

Disallow

/321546/

Disallow

/321406

Disallow

/321406/

Disallow

/318488

Disallow

/318488/

Disallow

/321143

Disallow

/321143/

Disallow

/331214

Disallow

/331214/

Disallow

/327909

Disallow

/327909/

Disallow

/335378

Disallow

/335378/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

Other Records

Field	Value
sitemap	https://kaliningradfirst.ru/sitemap_index.xml

Field

Value

sitemap

https://kaliningradfirst.ru/sitemap_index.xml

Warnings

`host` is not a known field.

kaliningradfirst.rurobots.txt

Resource Scan

Scan Details

Last Scan

Groups

ahrefsbot

mj12bot

blexbot

blp_bbot/0.1

blp_bbot

blp_bbot/0.1

blp_bbot

bingbot/2.0

mail.ru_bot

mail.ru_bot/2.0

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)

bingbot

uniplace-bot

dotbot

r6_commentreader

r6_feedfetcher

mail.ru

sputnikbot

kraken

kraken/0.1

mozilla/5.0 (compatible; kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

arachnys/nutch-1.12

trendictionbot

scrapy/1.2.2

scrapy

megaindex.ru/2.0

megaindex.ru

megaindex

semrushbot

semrushbot-sa

mozilla/5.0 (compatible; kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/fast/2.0; +http://go.mail.ru/help/robots)

mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)

domaincrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/kaliningradfirst.ru)

domaincrawler/3.0

domaincrawler

psbot

socredactorbot/1.2 (http://socredactor.ru; ; en-ru)

socredactorbot

*

Other Records

Other Records

Warnings

kaliningradfirst.ru
robots.txt