myfin.by
robots.txt
Robots Exclusion Standard data for myfin.by
Resource Scan
Scan Details
Site Domain | myfin.by |
Base Domain | myfin.by |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-18T12:14:19+00:00 |
Next Scan | 2024-11-16T12:14:19+00:00 |
Last Successful Scan
Scanned | 2023-04-27T08:21:41+00:00 |
URL | https://myfin.by/robots.txt |
Domain IPs | 95.130.85.164 |
Response IP | 95.130.85.164 |
Found | Yes |
Hash | bd5812c9cf4e182b20ba780a024eab2b5819bc2b89ce5862a0004873e54e75ae |
SimHash | a30c5d135948 |
Groups
*
Rule | Path |
---|---|
Allow | /*?page |
Allow | /currency/cb-rf/* |
Allow | /kredity/zayavka-na-rko |
Allow | /css/ |
Disallow | /*?page*& |
Disallow | /administrator/ |
Disallow | /admin* |
Disallow | /scripts/ |
Disallow | /gold10/ |
Disallow | /*cat_* |
Disallow | */creditcalc* |
Disallow | */depositcalc* |
Disallow | */sendcredit* |
Disallow | */senddeposit* |
Disallow | /site/search* |
Disallow | *?* |
Disallow | */city |
Disallow | /zabiray |
Disallow | /currency/*/*-*-* |
Disallow | /ajax/options/id |
Disallow | /wiki/search* |
Disallow | */Currencyrate2_sort/* |
Disallow | *?sort=* |
Disallow | /usercomments |
Disallow | /kredity/zayavka |
Disallow | /frame* |
Disallow | /kreditnyiy-reyting-2 |
Disallow | /kredity/podbor-online* |
Disallow | /kredity-alter/* |
Disallow | /karty-alter/* |
Disallow | /cards/alter* |
Disallow | /cards/alter |
Disallow | /stati/pre-view/* |
Disallow | /special-currency/* |
Disallow | /special-currency/ |
Disallow | /special-currency |
Disallow | /podbor/podbor-online* |
Disallow | /currency-new* |
Disallow | /currency-old* |
Disallow | /*/*/*/stati_page/ |
Disallow | */alter* |
Disallow | /personal-loans |
Allow | /scripts/xgemius.js |
Allow | /ajaxNews/limit/3 |
Allow | *?1* |
Other Records
Field | Value |
---|---|
sitemap | https://myfin.by/sitemap.xml |
sitemap | https://myfin.by/sitemap-news.xml |
Warnings
- `host` is not a known field.