perevody-deneg.ru
robots.txt

Robots Exclusion Standard data for perevody-deneg.ru

Resource Scan

Scan Details

Site Domain perevody-deneg.ru
Base Domain perevody-deneg.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/3/2025, 12:32:47 PM
Next Scan 6/10/2025, 12:32:47 PM

Last Successful Scan

Scanned4/21/2024, 7:01:13 PM
URL https://perevody-deneg.ru/robots.txt
Domain IPs 104.21.22.115, 172.67.204.144, 2606:4700:3030::6815:1673, 2606:4700:3033::ac43:cc90
Response IP 104.21.22.115
Found Yes
Hash 49352ad4b9df00202581102cc551958d289be4408924aef8417c7b923b28ba9d
SimHash 2333d420c8f1

Groups

*

Rule Path Comment
Allow / -
Disallow */list/otdeleniya/ -
Disallow */list/bankomats/ -
Disallow /rate.php -
Disallow /testpage/ -
Disallow /send_error/ -
Disallow */first -
Disallow *?q= -
Disallow *?ver= -
Disallow */gsearch1.php -
Disallow /bank/0 -
Disallow */credits/credit -
Disallow /online-credit/ -
Disallow /online-kredit/ -
Disallow /online-rko/ -
Disallow /goto/ -
Disallow /crypto/goto/* -
Disallow /anelik -
Disallow /scrs_new/ -
Disallow */bankomat/ -
Disallow */otdelenia/ -
Disallow *?ver= -
Disallow *blizko -
Disallow /countryfrom/% -
Disallow /countryfrom/countryto/ -
Disallow /index.php -
Disallow /poisk/* -
Disallow *?potreb-credit-sum-value -
Disallow *?__cf_chl_tk= -
Disallow /country/*/bank/*/city/*/map/bankomats/ -
Disallow /countryfrom/*/*/countryto/*/*/ -
Disallow /country/*/*/system/*/point/*/ -
Disallow /credits/calculator/ calc_block
Disallow *poisk%3D -
Disallow /system/%D0%9B%D0%B8%D0%B4%D0%B5%D1%80/ -
Disallow /system/Anelik/ -
Disallow /system/anelik/ -
Disallow /system/BLIZKO/ -
Disallow /system/Faster/ -
Disallow /system/InterExpress/ -
Disallow /system/WesternUnion/ -
Disallow /system/ZolotayaKorona/ -
Disallow /system/PrivatMoney/ -
Disallow /system/Migom/ -
Disallow /system/InterExpress/ -
Disallow /system/Migom/ -
Disallow /system/Kolibri/ -
Disallow /system/banks/ -
Disallow /calculator/ !
Disallow */micro/maloizvestnye-mfo// -
Disallow /kredit/*/id/*/ -

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

larbin

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

moget

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

linespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

linguee bot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.