ngs.ru
robots.txt
Robots Exclusion Standard data for ngs.ru
Resource Scan
Scan Details
Site Domain | ngs.ru |
Base Domain | ngs.ru |
Scan Status | Ok |
Last Scan | 2024-05-07T06:33:25+00:00 |
Next Scan | 2024-05-14T06:33:25+00:00 |
Last Scan
Scanned | 2024-05-07T06:33:25+00:00 |
URL | https://ngs.ru/robots.txt |
Domain IPs | 195.19.220.25 |
Response IP | 195.19.220.25 |
Found | Yes |
Hash | 658f17db0046bbd67f89d485e488bdf29cfc92de1f037b63e43fb48c84f263f7 |
SimHash | 1e145c30d367 |
Groups
yandexnews
Rule | Path |
---|---|
Allow | */yanews/ |
Allow | /rss/yandex/ |
Allow | *?from=yanews |
Allow | *?utm_source= |
Allow | /rss/ya/ |
*
Rule | Path |
---|---|
Disallow | */search |
Disallow | */comments$ |
Disallow | */comments/ |
Disallow | /admin |
Disallow | /export |
Disallow | /inc |
Disallow | *.swf |
Disallow | /happynewyear |
Disallow | /~ |
Disallow | */?share |
Disallow | /profile/ |
Disallow | /users/ |
Disallow | */votes/ |
Disallow | /subscription/ |
Disallow | /subscriptions/ |
Disallow | /award/confirm/ |
Disallow | /mailbox/ |
Disallow | /more/ |
Disallow | /gm-api/ |
Disallow | /preview/ |
Disallow | /quizzes/ |
Disallow | */?token= |
Disallow | */?ngs_ |
Disallow | */?amp |
Disallow | */?& |
Disallow | */%26 |
Disallow | *.pdf$ |
Disallow | /? |
Disallow | */?rubric= |
Disallow | *?discuss= |
Disallow | */?ngs_token= |
Disallow | */?dateFrom= |
Disallow | */*%26dateFrom%3D |
Disallow | */?set_cookie= |
Disallow | /text/*/? |
Disallow | /text/?page= |
Disallow | */?previewToken= |
Disallow | */?recordId= |
Disallow | *%26regionId%3D |
Disallow | *%26shareCard%3D |
Disallow | *?_ym_debug= |
Disallow | *?mindbox-message-key= |
Disallow | *?from= |
Disallow | *?utm_ |
Disallow | *?amp |
Disallow | *?etext= |
Disallow | */yanews/ |
Disallow | /text/longread/*/$ |
Disallow | *?startedAtGte= |
Disallow | *?place= |
Disallow | *?kids= |
Disallow | *?*free= |
Disallow | /afisha/all-events/ |
Disallow | /afisha/cinema-events/ |
Disallow | /afisha/concert-events/ |
Disallow | /afisha/theatre-events/ |
Disallow | /afisha/kids-events/ |
Disallow | /afisha/sport-events/ |
Disallow | /afisha/art-events/ |
Disallow | /afisha/other-events/ |
Other Records
Field | Value |
---|---|
sitemap | https://ngs.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
Comments