elementy.ru
robots.txt
Robots Exclusion Standard data for elementy.ru
Resource Scan
Scan Details
Site Domain | elementy.ru |
Base Domain | elementy.ru |
Scan Status | Ok |
Last Scan | 2024-05-18T10:13:17+00:00 |
Next Scan | 2024-06-17T10:13:17+00:00 |
Last Scan
Scanned | 2024-05-18T10:13:17+00:00 |
URL | https://elementy.ru/robots.txt |
Domain IPs | 185.17.10.59 |
Response IP | 185.17.10.59 |
Found | Yes |
Hash | 7deb724bf3bcc2bf34d46798f568477b586be278932d65a2854aa3eb593268da |
SimHash | 6e8ec0f08e13 |
Groups
*
Rule | Path |
---|---|
Disallow | /catalog |
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Disallow | /nauchno-populyarnaya_biblioteka/436253/* |
Disallow | /nauchno-populyarnaya_biblioteka/434138/* |
Disallow | /nauchno-populyarnaya_biblioteka/433975/* |
Disallow | /nauchno-populyarnaya_biblioteka/433461/* |
Disallow | /nauchno-populyarnaya_biblioteka/433284/* |
Disallow | /nauchno-populyarnaya_biblioteka/433230/* |
Disallow | /nauchno-populyarnaya_biblioteka/433231/* |
Disallow | /nauchno-populyarnaya_biblioteka/433081/* |
Disallow | /nauchno-populyarnaya_biblioteka/432805/* |
Disallow | /nauchno-populyarnaya_biblioteka/432728/* |
Disallow | /nauchno-populyarnaya_biblioteka/432727/* |
Disallow | /nauchno-populyarnaya_biblioteka/432696/* |
Disallow | /nauchno-populyarnaya_biblioteka/432678/* |
Disallow | /nauchno-populyarnaya_biblioteka/432631/* |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
yandex
Rule | Path |
---|---|
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /catalog/t |
Disallow | /catalog/g |
Disallow | /catalog/*/t1 |
Disallow | /catalog/*/t2 |
Disallow | /catalog/*/t3 |
Disallow | /catalog/*/t4 |
Disallow | /catalog/*/t5 |
Disallow | /catalog/*/t6 |
Disallow | /catalog/*/t7 |
Disallow | /catalog/*/t8 |
Disallow | /catalog/*/t9 |
Disallow | /catalog/*/g1 |
Disallow | /catalog/*/g2 |
Disallow | /catalog/*/g3 |
Disallow | /catalog/*/g4 |
Disallow | /catalog/*/g5 |
Disallow | /catalog/*/g6 |
Disallow | /catalog/*/g7 |
Disallow | /catalog/*/g8 |
Disallow | /catalog/*/g9 |
Disallow | /catalog/*/geo1 |
Disallow | /catalog/*/geo2 |
Disallow | /catalog/*/geo3 |
Disallow | /catalog/*/geo4 |
Disallow | /catalog/*/geo5 |
Disallow | /catalog/*/geo6 |
Disallow | /catalog/*/geo7 |
Disallow | /catalog/*/geo8 |
Disallow | /catalog/*/geo9 |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Disallow | /nauchno-populyarnaya_biblioteka/436253/* |
Disallow | /nauchno-populyarnaya_biblioteka/434138/* |
Disallow | /nauchno-populyarnaya_biblioteka/433975/* |
Disallow | /nauchno-populyarnaya_biblioteka/433461/* |
Disallow | /nauchno-populyarnaya_biblioteka/433284/* |
Disallow | /nauchno-populyarnaya_biblioteka/433230/* |
Disallow | /nauchno-populyarnaya_biblioteka/433231/* |
Disallow | /nauchno-populyarnaya_biblioteka/433081/* |
Disallow | /nauchno-populyarnaya_biblioteka/432805/* |
Disallow | /nauchno-populyarnaya_biblioteka/432728/* |
Disallow | /nauchno-populyarnaya_biblioteka/432727/* |
Disallow | /nauchno-populyarnaya_biblioteka/432696/* |
Disallow | /nauchno-populyarnaya_biblioteka/432678/* |
Disallow | /nauchno-populyarnaya_biblioteka/432631/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
googlebot
Rule | Path |
---|---|
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /catalog/t |
Disallow | /catalog/g |
Disallow | /catalog/*/t1 |
Disallow | /catalog/*/t2 |
Disallow | /catalog/*/t3 |
Disallow | /catalog/*/t4 |
Disallow | /catalog/*/t5 |
Disallow | /catalog/*/t6 |
Disallow | /catalog/*/t7 |
Disallow | /catalog/*/t8 |
Disallow | /catalog/*/t9 |
Disallow | /catalog/*/g1 |
Disallow | /catalog/*/g2 |
Disallow | /catalog/*/g3 |
Disallow | /catalog/*/g4 |
Disallow | /catalog/*/g5 |
Disallow | /catalog/*/g6 |
Disallow | /catalog/*/g7 |
Disallow | /catalog/*/g8 |
Disallow | /catalog/*/g9 |
Disallow | /catalog/*/geo1 |
Disallow | /catalog/*/geo2 |
Disallow | /catalog/*/geo3 |
Disallow | /catalog/*/geo4 |
Disallow | /catalog/*/geo5 |
Disallow | /catalog/*/geo6 |
Disallow | /catalog/*/geo7 |
Disallow | /catalog/*/geo8 |
Disallow | /catalog/*/geo9 |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Disallow | /nauchno-populyarnaya_biblioteka/436253/* |
Disallow | /nauchno-populyarnaya_biblioteka/434138/* |
Disallow | /nauchno-populyarnaya_biblioteka/433975/* |
Disallow | /nauchno-populyarnaya_biblioteka/433461/* |
Disallow | /nauchno-populyarnaya_biblioteka/433284/* |
Disallow | /nauchno-populyarnaya_biblioteka/433230/* |
Disallow | /nauchno-populyarnaya_biblioteka/433231/* |
Disallow | /nauchno-populyarnaya_biblioteka/433081/* |
Disallow | /nauchno-populyarnaya_biblioteka/432805/* |
Disallow | /nauchno-populyarnaya_biblioteka/432728/* |
Disallow | /nauchno-populyarnaya_biblioteka/432727/* |
Disallow | /nauchno-populyarnaya_biblioteka/432696/* |
Disallow | /nauchno-populyarnaya_biblioteka/432678/* |
Disallow | /nauchno-populyarnaya_biblioteka/432631/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
mail.ru
Rule | Path |
---|---|
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /catalog/t |
Disallow | /catalog/g |
Disallow | /catalog/*/t1 |
Disallow | /catalog/*/t2 |
Disallow | /catalog/*/t3 |
Disallow | /catalog/*/t4 |
Disallow | /catalog/*/t5 |
Disallow | /catalog/*/t6 |
Disallow | /catalog/*/t7 |
Disallow | /catalog/*/t8 |
Disallow | /catalog/*/t9 |
Disallow | /catalog/*/g1 |
Disallow | /catalog/*/g2 |
Disallow | /catalog/*/g3 |
Disallow | /catalog/*/g4 |
Disallow | /catalog/*/g5 |
Disallow | /catalog/*/g6 |
Disallow | /catalog/*/g7 |
Disallow | /catalog/*/g8 |
Disallow | /catalog/*/g9 |
Disallow | /catalog/*/geo1 |
Disallow | /catalog/*/geo2 |
Disallow | /catalog/*/geo3 |
Disallow | /catalog/*/geo4 |
Disallow | /catalog/*/geo5 |
Disallow | /catalog/*/geo6 |
Disallow | /catalog/*/geo7 |
Disallow | /catalog/*/geo8 |
Disallow | /catalog/*/geo9 |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
ahrefsbot
Rule | Path |
---|---|
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /catalog/t |
Disallow | /catalog/g |
Disallow | /catalog/*/t1 |
Disallow | /catalog/*/t2 |
Disallow | /catalog/*/t3 |
Disallow | /catalog/*/t4 |
Disallow | /catalog/*/t5 |
Disallow | /catalog/*/t6 |
Disallow | /catalog/*/t7 |
Disallow | /catalog/*/t8 |
Disallow | /catalog/*/t9 |
Disallow | /catalog/*/g1 |
Disallow | /catalog/*/g2 |
Disallow | /catalog/*/g3 |
Disallow | /catalog/*/g4 |
Disallow | /catalog/*/g5 |
Disallow | /catalog/*/g6 |
Disallow | /catalog/*/g7 |
Disallow | /catalog/*/g8 |
Disallow | /catalog/*/g9 |
Disallow | /catalog/*/geo1 |
Disallow | /catalog/*/geo2 |
Disallow | /catalog/*/geo3 |
Disallow | /catalog/*/geo4 |
Disallow | /catalog/*/geo5 |
Disallow | /catalog/*/geo6 |
Disallow | /catalog/*/geo7 |
Disallow | /catalog/*/geo8 |
Disallow | /catalog/*/geo9 |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
bingbot
Rule | Path |
---|---|
Disallow | /testblogs/ |
Disallow | /blogs/ |
Disallow | /catalog/t |
Disallow | /catalog/g |
Disallow | /catalog/*/t1 |
Disallow | /catalog/*/t2 |
Disallow | /catalog/*/t3 |
Disallow | /catalog/*/t4 |
Disallow | /catalog/*/t5 |
Disallow | /catalog/*/t6 |
Disallow | /catalog/*/t7 |
Disallow | /catalog/*/t8 |
Disallow | /catalog/*/t9 |
Disallow | /catalog/*/g1 |
Disallow | /catalog/*/g2 |
Disallow | /catalog/*/g3 |
Disallow | /catalog/*/g4 |
Disallow | /catalog/*/g5 |
Disallow | /catalog/*/g6 |
Disallow | /catalog/*/g7 |
Disallow | /catalog/*/g8 |
Disallow | /catalog/*/g9 |
Disallow | /catalog/*/geo1 |
Disallow | /catalog/*/geo2 |
Disallow | /catalog/*/geo3 |
Disallow | /catalog/*/geo4 |
Disallow | /catalog/*/geo5 |
Disallow | /catalog/*/geo6 |
Disallow | /catalog/*/geo7 |
Disallow | /catalog/*/geo8 |
Disallow | /catalog/*/geo9 |
Disallow | /find |
Disallow | /novosti_nauki/t |
Disallow | /LHC/novosti_BAK/t |
Disallow | /kartinka_dnya/t |
Disallow | /problems/t |
Disallow | /problems/a |
Disallow | /nauchno-populyarnaya_biblioteka/t/ |
Disallow | /video/a |
Disallow | /video/t |
Disallow | /video/l |
Disallow | /events*archive%3D1 |
Disallow | /events*period%3Dd |
Disallow | /events*plcid%3D |
Disallow | /events*lctid%3D |
Disallow | /events*prjid%3D |
Disallow | /events*xtypid%3D |
Disallow | /events*audid%3D |
Disallow | *%26PREVIEW |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.