amur.info
robots.txt

Robots Exclusion Standard data for amur.info

Archived Snapshots

Resource Scan

Scan Details

Site Domain	amur.info
Base Domain	amur.info
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a client error.
Last Scan	2024-05-06T02:10:36+00:00
Next Scan	2024-08-04T02:10:36+00:00

Last Successful Scan

Scanned	2023-10-08T23:46:11+00:00
URL	https://www.amur.info/robots.txt
Domain IPs	185.178.208.157
Response IP	185.178.208.157
Found	Yes
Hash	2d4259530e6b3c6e323b6d136dd18cbc335f1f5a7b753127690453ab967a8df9
SimHash	e287cb6226ab

Groups

*

Rule	Path
Disallow	/wp-content/themes
Disallow	/cgi-bin
Disallow	/wp-admin
Disallow	/wp-includes
Disallow	/wp-content/plugins
Disallow	/wp-content/cache
Disallow	/wp-json/
Disallow	/wp-login.php
Disallow	/wp-register.php
Disallow	*/embed
Disallow	/xmlrpc.php
Disallow	/?*
Disallow	/?s=
Disallow	/search
Disallow	/author/
Disallow	*/trackback
Disallow	//trackback
Disallow	/*_openstat
Disallow	/*printable
Disallow	/print
Disallow	/zire.php
Disallow	/savetool.php
Disallow	/?location=
Disallow	*/?podmena
Disallow	/?location
Disallow	/?keyword
Disallow	/?p=
Disallow	/?article-category=*
Disallow	/page/*
Disallow	/?erid=*
Disallow	/?ysclid=*
Allow	/wp-content/plugins/*.js
Allow	/wp-content/plugins/*.css
Allow	/wp-content/cache/*.js
Allow	/wp-content/cache/*.css
Allow	/wp-includes/*.js
Allow	/wp-includes/*.css
Allow	/wp-content/plugins/*.css
Allow	/wp-content/plugins/*.js
Allow	/wp-content/themes/*.js
Allow	/wp-content/themes/*.css
Allow	/wp-content/themes/*.gif
Allow	/wp-content/themes/*.png
Allow	/wp-content/themes/*.jpeg
Allow	/wp-content/themes/*.jpg
Allow	/wp-content/themes/*.JPG
Allow	/wp-content/themes/*.woff
Allow	/wp-content/themes/*.woff2
Allow	/wp-content/themes/*.ttf
Allow	/wp-content/plugins/*.gif
Allow	/wp-content/plugins/*.png
Allow	/wp-content/plugins/*.jpeg
Allow	/wp-content/plugins/*.jpg
Allow	/wp-content/plugins/*.JPG

Rule

Path

Disallow

/wp-content/themes

Disallow

/cgi-bin

Disallow

/wp-admin

Disallow

/wp-includes

Disallow

/wp-content/plugins

Disallow

/wp-content/cache

Disallow

/wp-json/

Disallow

/wp-login.php

Disallow

/wp-register.php

Disallow

*/embed

Disallow

/xmlrpc.php

Disallow

/?*

Disallow

/?s=

Disallow

/search

Disallow

/author/

Disallow

*/trackback

Disallow

*/*/trackback

Disallow

/*_openstat

Disallow

/*printable

Disallow

/print

Disallow

/zire.php

Disallow

/savetool.php

Disallow

/?location=

Disallow

*/?podmena

Disallow

/?location

Disallow

/?keyword

Disallow

/?p=

Disallow

/?article-category=*

Disallow

/page/*

Disallow

/?erid=*

Disallow

/?ysclid=*

Allow

/wp-content/plugins/*.js

Allow

/wp-content/plugins/*.css

Allow

/wp-content/cache/*.js

Allow

/wp-content/cache/*.css

Allow

/wp-includes/*.js

Allow

/wp-includes/*.css

Allow

/wp-content/plugins/*.css

Allow

/wp-content/plugins/*.js

Allow

/wp-content/themes/*.js

Allow

/wp-content/themes/*.css

Allow

/wp-content/themes/*.gif

Allow

/wp-content/themes/*.png

Allow

/wp-content/themes/*.jpeg

Allow

/wp-content/themes/*.jpg

Allow

/wp-content/themes/*.JPG

Allow

/wp-content/themes/*.woff

Allow

/wp-content/themes/*.woff2

Allow

/wp-content/themes/*.ttf

Allow

/wp-content/plugins/*.gif

Allow

/wp-content/plugins/*.png

Allow

/wp-content/plugins/*.jpeg

Allow

/wp-content/plugins/*.jpg

Allow

/wp-content/plugins/*.JPG

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex

Rule	Path
Disallow	/

Rule

Path

Disallow

java

Rule	Path
Disallow	/

Rule

Path

Disallow

njuicebot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

js-kit

Rule	Path
Disallow	/

Rule

Path

Disallow

hybridbot

Rule	Path
Disallow	/

Rule

Path

Disallow

voyager

Rule	Path
Disallow	/

Rule

Path

Disallow

postrank

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71

Rule	Path
Disallow	/

Rule

Path

Disallow

surveybot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

aport

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

butterfly

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

sweb

Rule	Path
Disallow	/

Rule

Path

Disallow

linkexchanger

Rule	Path
Disallow	/

Rule

Path

Disallow

soup

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshotcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

wordpress

Rule	Path
Disallow	/

Rule

Path

Disallow

dnyzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

deusu

Rule	Path
Disallow	/

Rule

Path

Disallow

mlbot

Rule	Path
Disallow	/

Rule

Path

Disallow

internetseer

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

fairshare

Rule	Path
Disallow	/

Rule

Path

Disallow

yeti

Rule	Path
Disallow	/

Rule

Path

Disallow

birubot

Rule	Path
Disallow	/

Rule

Path

Disallow

yottosbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linguee

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

lwp-trivial

Rule	Path
Disallow	/

Rule

Path

Disallow

purebot

Rule	Path
Disallow	/

Rule

Path

Disallow

kmsearchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sitebot

Rule	Path
Disallow	/

Rule

Path

Disallow

camontspider

Rule

Path

Disallow

ptd-crawler

Rule

Path

Disallow

httrack

Rule

Path

Disallow

suggybot

Rule

Path

Disallow

ttcrawler

Rule

Path

Disallow

nutch

Rule

Path

Disallow

msnbot

Rule

Path

Disallow

msnbot-media

Rule

Path

Disallow

slurp

Rule

Path

Disallow

zeus

Rule

Path

Disallow

abonti

Rule

Path

Disallow

aggregator

Rule

Path

Disallow

asterias

Rule

Path

Disallow

bdcbot

Rule

Path

Disallow

blexbot

Rule

Path

Disallow

builtbottough

Rule

Path

Disallow

bullseye

Rule

Path

Disallow

bunnyslippers

Rule

Path

Disallow

cegbfeieh

Rule

Path

Disallow

cheesebot

Rule

Path

Disallow

cherrypicker

Rule

Path

Disallow

coccoc

Rule

Path

Disallow

copyrightcheck

Rule

Path

Disallow

cosmos

Rule

Path

Disallow

crescent

Rule

Path

Disallow

discobot

Rule

Path

Disallow

dittospyder

Rule

Path

Disallow

download ninja

Rule

Path

Disallow

easouspider

Rule

Path

Disallow

emailcollector

Rule

Path

Disallow

emailsiphon

Rule

Path

Disallow

emailwolf

Rule

Path

Disallow

erocrawler

Rule

Path

Disallow

extractorpro

Rule

Path

Disallow

fasterfox

Rule

Path

Disallow

feedbooster

Rule

Path

Disallow

foobot

Rule

Path

Disallow

genieo

Rule

Path

Disallow

harvest

Rule

Path

Disallow

hloader

Rule

Path

Disallow

httplib

Rule

Path

Disallow

humanlinks

Rule

Path

Disallow

ieautodiscovery

Rule

Path

Disallow

incutio

Rule

Path

Disallow

infonavirobot

Rule

Path

Disallow

istellabot

Rule

Path

Disallow

jamesbot

Rule

Path

Disallow

jennybot

Rule

Path

Disallow

k2spider

Rule

Path

Disallow

kenjin spider

Rule

Path

Disallow

lexibot

Rule

Path

Disallow

libweb

Rule

Path

Disallow

linkextractorpro

Rule

Path

Disallow

linko

Rule

Path

Disallow

linkscan/8\.1a unix

Rule

Path

Disallow

linkwalker

Rule

Path

Disallow

lmspider

Rule

Path

Disallow

lnspiderguy

Rule

Path

Disallow

magpie

Rule

Path

Disallow

mata hari

Rule

Path

Disallow

maxpointcrawler

Rule

Path

Disallow

memorybot

Rule

Path

Disallow

microsoft url control

Rule

Path

Disallow

miixpc

Rule

Path

Disallow

mippin

Rule

Path

Disallow

missigua locator

Rule

Path

Disallow

mister pix

Rule

Path

Disallow

moget

Rule

Path

Disallow

msiecrawler

Rule

Path

Disallow

netants

Rule

Path

Disallow

nicerspro

Rule

Path

Disallow

npbot

Rule

Path

Disallow

offline explorer

Rule

Path

Disallow

olecrawler

Rule

Path

Disallow

openfind

Rule

Path

Disallow

prowebwalker

Rule

Path

Disallow

queryn metasearch

Rule

Path

Disallow

repomonkey

Rule

Path

Disallow

riddler

Rule

Path

Disallow

rma

Rule

Path

Disallow

serf

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sitesnagger

Rule

Path

Disallow

serpstat

Rule

Path

Disallow

snappreviewbot

Rule

Path

Disallow

sogou

Rule

Path

Disallow

spankbot

Rule

Path

Disallow

spanner

Rule

Path

Disallow

spinn3r

Rule

Path

Disallow

spyfu

Rule

Path

Disallow

suzuran

Rule

Path

Disallow

szukacz/1\.4

Rule

Path

Disallow

teleport

Rule

Path

Disallow

telesoft

Rule

Path

Disallow

the intraformant

Rule

Path

Disallow

thenomad

Rule

Path

Disallow

tighttwatbot

Rule

Path

Disallow

titan

Rule

Path

Disallow

tocrawl/urldispatcher

Rule

Path

Disallow

true_robot

Rule

Path

Disallow

turingos

Rule

Path

Disallow

turnitinbot

Rule

Path

Disallow

ubicrawler

Rule

Path

Disallow

unisterbot

Rule

Path

Disallow

unknown

Rule

Path

Disallow

uptime files

Rule

Path

Disallow

urly warning

Rule

Path

Disallow

user-agent

Rule

Path

Disallow

vci

Rule

Path

Disallow

vedma

Rule

Path

Disallow

wbsearchbot

Rule

Path

Disallow

web image collector

Rule

Path

Disallow

webauto

Rule

Path

Disallow

webbandit

Rule

Path

Disallow

webcopier

Rule

Path

Disallow

webenhancer

Rule

Path

Disallow

webmasterworldforumbot

Rule

Path

Disallow

webreaper

Rule

Path

Disallow

websauger

Rule

Path

Disallow

website quester

Rule

Path

Disallow

webster pro

Rule

Path

Disallow

webstripper

Rule

Path

Disallow

webzip

Rule

Path

Disallow

wotbox

Rule

Path

Disallow

zao

Rule

Path

Disallow

zyborg

Rule

Path

Disallow

ahrefs

Rule

Path

Disallow

qwantify

Rule

Path

Disallow

qwant

Rule

Path

Disallow

semrush

Rule

Path

Disallow

detectify

Rule

Path

Disallow

linkpadbot

Rule

Path

Disallow

flipboardproxy

Rule

Path

Disallow

aihitbot

Rule

Path

Disallow

trovitbot

Rule

Path

Disallow

Other Records

Field

Value

sitemap

https://amur.info/sitemap.xml

sitemap

https://amur.info/sitemap-images.xml

amur.inforobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

*

mj12bot

ahrefsbot

dotbot

semrushbot

megaindex

java

njuicebot

gigabot

scrapy

seznambot

crawler

js-kit

hybridbot

voyager

postrank

domaincrawler

ltx71

surveybot

exabot

aport

ccbot

ia_archiver

larbin

butterfly

libwww

wget

sweb

linkexchanger

soup

grapeshotcrawler

wordpress

dnyzbot

spbot

deusu

mlbot

internetseer

bubing

fairshare

yeti

birubot

yottosbot

linguee

ezooms

lwp-trivial

purebot

kmsearchbot

sitebot

camontspider

ptd-crawler

httrack

suggybot

ttcrawler

nutch

msnbot

msnbot-media

slurp

zeus

abonti

aggregator

asterias

bdcbot

blexbot

builtbottough

bullseye

bunnyslippers

cegbfeieh

cheesebot

cherrypicker

coccoc

copyrightcheck

cosmos

crescent

discobot

dittospyder

amur.info
robots.txt