sravni.ru
robots.txt
Robots Exclusion Standard data for sravni.ru
Resource Scan
Scan Details
| Site Domain | sravni.ru |
| Base Domain | sravni.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-29T17:56:40+00:00 |
| Next Scan | 2024-12-28T17:56:40+00:00 |
Last Successful Scan
| Scanned | 2022-12-06T17:12:50+00:00 |
| URL | https://sravni.ru/robots.txt |
| Redirect | https://www.sravni.ru/robots.txt |
| Redirect Domain | www.sravni.ru |
| Redirect Base | sravni.ru |
| Domain IPs | 104.18.24.181, 104.18.25.181, 2606:4700::6812:18b5, 2606:4700::6812:19b5 |
| Redirect IPs | 104.18.24.181, 104.18.25.181, 2606:4700::6812:18b5, 2606:4700::6812:19b5 |
| Response IP | 104.18.25.181 |
| Found | Yes |
| Hash | 184f4fd0c2484c15f048a49f7affdef8d53cb495670294119ea90dfa0b9b6b29 |
| SimHash | e2a959e34a59 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /diagnostics/* |
| Disallow | /login/* |
| Disallow | */amp/* |
| Disallow | /m/* |
| Disallow | /pay/* |
| Disallow | /logout/* |
| Disallow | /user/* |
| Disallow | */policies/* |
| Disallow | */success* |
| Disallow | /p/* |
| Disallow | */api/* |
| Disallow | /provider/* |
| Disallow | */href$ |
| Disallow | */href/* |
| Disallow | *.php$ |
| Disallow | *%* |
| Disallow | *%7B* |
| Disallow | *%27* |
| Disallow | *%3B* |
| Disallow | *%29* |
| Disallow | /r/* |
| Disallow | */travel/* |
| Disallow | /*?* |
| Disallow | /*%26* |
| Disallow | /*.ashx |
| Disallow | /*.aspx |
| Disallow | /redirect |
| Disallow | *jumpid%3D |
| Disallow | */Pages/* |
| Disallow | /net/ |
| Disallow | */handlers/* |
| Disallow | */Handlers/* |
| Disallow | */ajax/* |
| Disallow | /vybor-regiona/$ |
| Disallow | /banki/poisk/*/ |
| Disallow | /about/vacancy/* |
| Disallow | /banki/bankomaty/* |
| Disallow | */calculator/* |
| Disallow | /banki/poisk/po-adresu/ |
| Disallow | /touronline |
| Disallow | */raschet/* |
| Disallow | /Savings/ |
| Disallow | */driverView/ |
| Disallow | */add/$ |
| Disallow | */add$ |
| Disallow | /credits/* |
| Disallow | /kredity-v2/* |
| Disallow | */kredity/podbor-onlajn-v3/* |
| Disallow | /lead/* |
| Disallow | /promo/* |
| Disallow | /q/ask/* |
| Disallow | /q/my/* |
| Disallow | /q/tags/* |
| Disallow | /q/poisk/* |
| Disallow | /q/ekspert/* |
| Disallow | /osago-new/* |
| Disallow | /vzr2/* |
| Disallow | /avto/* |
| Disallow | /avtodiler/* |
| Disallow | /avtodilery/* |
| Disallow | /avtoservis/* |
| Disallow | /avtoservisy/* |
| Disallow | */carUsage/* |
| Disallow | */paramsUsage/* |
| Disallow | */carUsage/* |
| Disallow | */carParamsUsage/* |
| Disallow | */marki/* |
| Disallow | */valjuty/kursy-valjut-bankov/*/*/ |
| Disallow | /valjuty/kursy-valjut-cb-rf/*/ |
| Disallow | /novosti/strakhovki/* |
| Disallow | /strahovka/stati/* |
| Disallow | *-ao/$ |
| Disallow | *-kraj/$ |
| Disallow | *-oblast/$ |
| Disallow | */adygeja/$ |
| Disallow | */bashkortostan/$ |
| Disallow | */burjatija/$ |
| Disallow | */chechnja/$ |
| Disallow | */kabardino-balkarija/$ |
| Disallow | */kalmykija/$ |
| Disallow | */karachaevo-cherkesija/$ |
| Disallow | */karelija/$ |
| Disallow | */krym/$ |
| Disallow | */mordovija/$ |
| Disallow | */ingushetija/$ |
| Disallow | */severnaja-osetija/$ |
| Disallow | */tatarstan/$ |
| Disallow | */tyva/$ |
| Disallow | */udmurtija/$ |
| Disallow | /strafy-gibdd/* |
| Disallow | /avtokredity-* |
| Disallow | /banki-goroda/* |
| Disallow | /category* |
| Disallow | /calculator* |
| Disallow | /dengi* |
| Disallow | /docs* |
| Disallow | /dokhodnye-* |
| Disallow | /dsago* |
| Disallow | /elektronnyj-* |
| Disallow | /enciklopediya/*/novosti/rubrika/* |
| Disallow | /faq/* |
| Disallow | /gosudarstvennaja-* |
| Disallow | /kredit-* |
| Disallow | /kreditnye-* |
| Disallow | /kredity-* |
| Disallow | /karty-* |
| Disallow | /ipoteka-* |
| Disallow | /labs/* |
| Disallow | /mutivaljutnye-* |
| Disallow | /osago-* |
| Disallow | /potrebitelskie-* |
| Disallow | /prodlit-* |
| Disallow | /refinansirovanie-* |
| Disallow | /sotsialnaya-* |
| Disallow | /srochnye-* |
| Disallow | /stati/* |
| Disallow | /strahovanie-doma/* |
| Disallow | /strahovanie-kvartiry/* |
| Disallow | /strahovanie-zhilja/* |
| Disallow | /strahovka/* |
| Disallow | /strakhovki/* |
| Disallow | /tag/* |
| Disallow | /vklady/*/calculator/ |
| Disallow | /vklady-* |
| Disallow | /voennaya-* |
| Disallow | /zagorodnaja-* |
| Disallow | /zaimy-* |
| Disallow | /zemelnaja-* |
| Disallow | /zelenaja-karta/* |
| Disallow | /zhile-* |
| Allow | /handlers/yandexhandler.ashx |
| Allow | /promo/2020uhodi/ |
baiduspider
blexbot
dotbot
emailcollector
emailsiphon
larbin
linkpadbot
moget
msiecrawler
mj12bot
npbot
npbot-1/2.0
nutch
offline explorer
psbot
semrushbot
sitesnagger
sogou spider
teleport
teleportpro
turnitinbot
webcopier
webstripper
trovitbot
trendictionbot
criteobot/0.1
linkdexbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /diagnostics/* |
| Disallow | /login/* |
| Disallow | /logout/* |
| Disallow | /user/* |
| Disallow | /p/* |
| Disallow | /m/* |
| Disallow | /pay/* |
| Disallow | */policies/* |
| Disallow | */success* |
| Disallow | */api/* |
| Disallow | /provider/* |
| Disallow | */href$ |
| Disallow | */href/* |
| Disallow | *.php$ |
| Disallow | *%* |
| Disallow | *%7B* |
| Disallow | *%27* |
| Disallow | *%3B* |
| Disallow | *%29* |
| Disallow | /r/* |
| Disallow | */travel/* |
| Disallow | *?* |
| Disallow | *%26* |
| Disallow | */wl/* |
| Disallow | *.ashx* |
| Disallow | *.aspx* |
| Disallow | /redirect* |
| Disallow | /*jumpid%3D* |
| Disallow | /Pages/ |
| Disallow | /net/ |
| Disallow | /handlers/* |
| Disallow | /Handlers/* |
| Disallow | /ajax/* |
| Disallow | /banki/poisk/*/* |
| Disallow | /about/vacancy/* |
| Disallow | /banki/bankomaty/* |
| Disallow | */calculator/* |
| Disallow | /banki/poisk/po-adresu/ |
| Disallow | /touronline |
| Disallow | */raschet/* |
| Disallow | /Savings/* |
| Disallow | */driverView/* |
| Disallow | */add/* |
| Disallow | */add$ |
| Disallow | /credits/* |
| Disallow | /kredity-v2/* |
| Disallow | */kredity/podbor-onlajn-v3/* |
| Disallow | /lead/* |
| Disallow | /promo/* |
| Disallow | /q/ask/* |
| Disallow | /q/my/* |
| Disallow | /q/tags/* |
| Disallow | /q/poisk/* |
| Disallow | /q/ekspert/* |
| Disallow | /osago-new/* |
| Disallow | /vzr2/* |
| Disallow | /avto/* |
| Disallow | /avtodiler/* |
| Disallow | /avtodilery/* |
| Disallow | /avtoservis/* |
| Disallow | /avtoservisy/* |
| Disallow | */carUsage/* |
| Disallow | */paramsUsage/* |
| Disallow | */carUsage/* |
| Disallow | */carParamsUsage/* |
| Disallow | */marki/* |
| Disallow | */valjuty/kursy-valjut-bankov/*/*/* |
| Disallow | /valjuty/kursy-valjut-cb-rf/*/* |
| Disallow | /novosti/strakhovki/* |
| Disallow | /strahovka/stati/* |
| Disallow | *-ao/$ |
| Disallow | *-kraj/$ |
| Disallow | *-oblast/$ |
| Disallow | */adygeja/$ |
| Disallow | */bashkortostan/$ |
| Disallow | */burjatija/$ |
| Disallow | */chechnja/$ |
| Disallow | */kabardino-balkarija/$ |
| Disallow | */kalmykija/$ |
| Disallow | */karachaevo-cherkesija/$ |
| Disallow | */karelija/$ |
| Disallow | */krym/$ |
| Disallow | */mordovija/$ |
| Disallow | */ingushetija/$ |
| Disallow | */severnaja-osetija/$ |
| Disallow | */tatarstan/$ |
| Disallow | */tyva/$ |
| Disallow | */udmurtija/$ |
| Disallow | /strafy-gibdd/* |
| Disallow | /avtokredity-* |
| Disallow | /banki-goroda/* |
| Disallow | /category* |
| Disallow | /calculator* |
| Disallow | /dengi* |
| Disallow | /docs* |
| Disallow | /dokhodnye-* |
| Disallow | /dsago* |
| Disallow | /elektronnyj-* |
| Disallow | /enciklopediya/*/novosti/rubrika/* |
| Disallow | /faq/* |
| Disallow | /gosudarstvennaja-* |
| Disallow | /kredit-* |
| Disallow | /kreditnye-* |
| Disallow | /kredity-* |
| Disallow | /karty-* |
| Disallow | /ipoteka-* |
| Disallow | /labs/* |
| Disallow | /mutivaljutnye-* |
| Disallow | /osago-* |
| Disallow | /potrebitelskie-* |
| Disallow | /prodlit-* |
| Disallow | /refinansirovanie-* |
| Disallow | /sotsialnaya-* |
| Disallow | /srochnye-* |
| Disallow | /stati/* |
| Disallow | /strahovanie-doma/* |
| Disallow | /strahovanie-kvartiry/* |
| Disallow | /strahovanie-zhilja/* |
| Disallow | /strahovka/* |
| Disallow | /strakhovki/* |
| Disallow | /tag/* |
| Disallow | /vklady/*/calculator/ |
| Disallow | /vklady-* |
| Disallow | /voennaya-* |
| Disallow | /zagorodnaja-* |
| Disallow | /zaimy-* |
| Disallow | /zemelnaja-* |
| Disallow | /zelenaja-karta/* |
| Disallow | /zhile-* |
| Allow | /promo/2020uhodi/ |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments