Log In Sign Up

inforesist.org
robots.txt

Robots Exclusion Standard data for inforesist.org

Resource Scan

Scan Details

Site Domain inforesist.org
Base Domain inforesist.org
Scan Status Ok
Last Scan2024-11-16T18:57:53+00:00
Next Scan 2024-11-23T18:57:53+00:00

Last Scan

Scanned2024-11-16T18:57:53+00:00
URL https://inforesist.org/robots.txt
Domain IPs 104.26.6.237, 104.26.7.237, 172.67.73.66, 2606:4700:20::681a:6ed, 2606:4700:20::681a:7ed, 2606:4700:20::ac43:4942
Response IP 172.67.73.66
Found Yes
Hash 09b15f14b66cc1fd9210d0f8ad508ffa26413330688a75a1a314ddc7cf4c786d
SimHash 793053536eb3

Groups

googlebot

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /wp-content/uploads*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

yandex

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /wp-content/uploads*
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

yandexbot

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /wp-content/uploads*
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

msnbot

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

stackrambler

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

mail.ru

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

Other Records

Field Value
crawl-delay 4.5

aport

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /wp-admin
Disallow /redakciya/
Disallow /wp-includes
Disallow /wp-content
Disallow /archive
Disallow /goto/
Disallow /sales/
Disallow */trackback/
Disallow /wp-content/languages/ru_RU.po
Disallow */feed/
Disallow */comments/
Disallow /wp-json/*
Disallow /ua/wp-json/*
Disallow /?feed=
Disallow /?s=
Disallow /ponomarev-pereimenoval-slavyansk-v-putinsk/
Disallow /pomoshh-proektu/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Allow /wp-content/themes/inforesist/style.css
Allow /wp-content/themes/inforesist/assets/js/
Disallow /wp-includes/
Allow /opinion/*

webalta

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /wp-admin
Disallow /redakciya/
Disallow /wp-includes
Disallow /wp-content
Disallow /archive
Disallow /goto/
Disallow /sales/
Disallow */trackback/
Disallow /wp-content/languages/ru_RU.po
Disallow */feed/
Disallow */comments/
Disallow /wp-json/*
Disallow /ua/wp-json/*
Disallow /?feed=
Disallow /?s=
Disallow /ponomarev-pereimenoval-slavyansk-v-putinsk/
Disallow /pomoshh-proektu/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Allow /wp-content/themes/inforesist/style.css
Allow /wp-content/themes/inforesist/assets/js/
Disallow /wp-includes/
Allow /opinion/*

yandexnews

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

yandexpagechecker

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

yandexmedia

Rule Path
Disallow /*
Allow /wp-content/uploads/
Allow /feed/turbo/

yandeximages

Rule Path
Disallow /*
Allow /wp-content/uploads/
Allow /feed/turbo/

googlebot-image

Rule Path
Disallow /*
Allow /wp-content/uploads/

googlebot-mobile

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /wp-content/uploads*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

googlebot-news

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*
Allow /opinion/*
Allow /wp-content/uploads*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

slurp

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=
Allow /opinion/*
Allow /feed/turbo/
Allow /*?amp=2
Allow /*?amp=1
Allow /*?amp
Allow /?amp

twitterbot

Rule Path
Disallow *
Allow /images
Allow /archives
Allow /wp-content/uploads*

*

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow /sales/
Disallow /TR/
Disallow */comments/
Disallow /?s=

mediapartners-google

Rule Path
Disallow
Allow /*

addthis

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexabot

Rule Path
Disallow /

amznkassocbot/4.0

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bdcbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bsalsa

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

docomo/2.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

findxbot/1.0

Rule Path
Disallow /

genieo

Rule Path
Disallow /

gluten free crawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

hypercrawl

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

ichiro/3.0

Rule Path
Disallow /

ichiro/4.0

Rule Path
Disallow /

infoweb

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkdexbot/2.1

Rule Path
Disallow /

linkdexbot/2.2

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

nutch bots

Rule Path
Disallow /

obot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

phpservermon/3.1.1

Rule Path
Disallow /

privacyawarebot/1.1

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sf/2 (skipfish)

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sogou head spider/3.0

Rule Path
Disallow /

sogou orion spider/3.0

Rule Path
Disallow /

sogou pic agent

Rule Path
Disallow /

sogou pic spider/3.0

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

sunrise

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

tdjbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tweetmeme

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

unwindfetchor

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

uptimebot/1.0

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

wget

Rule Path
Disallow /

wget

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

y! j-asr

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yoozbot-2.2

Rule Path
Disallow /

youdaobot/1.0

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

yahoo-slurp

Rule Path
Disallow /

anews/1.0

Rule Path
Disallow /

anews

Rule Path
Disallow /

kribrum

Rule Path
Disallow /

kribrum/0.1

Rule Path
Disallow /

iskanie

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

special_archiver/3.1.1

Rule Path
Disallow /

special_archiver

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.1

Rule Path
Disallow /

semrushbot-sa/0.97

Rule Path
Disallow /

um-fc

Rule Path
Disallow /

um-fc/1.0

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

um-ln/1.0

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

deusu/5.0.2

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

bitlybot/3.0

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

scrapy/1.2.2

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

guzzlehttp/6.1.0

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

stackrambler

Rule Path
Disallow /

metaspider

Rule Path
Disallow /

aport

Rule Path
Disallow /

scooter

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

kraken

Rule Path
Disallow /

kraken/0.1

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

bubing

Rule Path
Disallow /

yeti/1.1

Rule Path
Disallow /

seznambot/3.2

Rule Path
Disallow /

webartexbot

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

spbot/5.0.3

Rule Path
Disallow /

spbot

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ic/1.0

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

gingercrawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

urlbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

grouphigh

Rule Path
Disallow /

grouphigh/1.0

Rule Path
Disallow /

mj12bot/v1.4.3

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

mj12bot/v1.2.4

Rule Path
Disallow /

mj12bot/v1.2.3

Rule Path
Disallow /

mj12bot/v1.0.8

Rule Path
Disallow /

mj12bot/v1.0.7

Rule Path
Disallow /

mj12bot/v1.0.6

Rule Path
Disallow /

mj12bot/v1.0.5

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /

mj12bot/v1.4.6

Rule Path
Disallow /

mj12bot/v1.4.7

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

rogerbot/1.0

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

steeler/3.5

Rule Path
Disallow /

steeler

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

ahrefsbot/1.0

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

ahrefsbot/3.0

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

ahrefsbot/3.1

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

boitho

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

collaborator

Rule Path
Allow /*
Disallow /*?
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-admin
Disallow */trackback/
Disallow /goto/
Disallow */comments/
Disallow /?s=
Disallow /wp-json/*
Disallow /ua/wp-json/*

sentibot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
sitemap https://inforesist.org/sitemap_index.xml
Back to top

Warnings

  • 12 invalid lines.
  • `host` is not a known field.
Back to top