theday.ru
robots.txt
Robots Exclusion Standard data for theday.ru
Resource Scan
Scan Details
| Site Domain | theday.ru |
| Base Domain | theday.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-15T03:18:35+00:00 |
| Next Scan | 2024-09-22T03:18:35+00:00 |
Last Scan
| Scanned | 2024-09-15T03:18:35+00:00 |
| URL | https://theday.ru/robots.txt |
| Domain IPs | 195.226.222.236 |
| Response IP | 195.226.222.236 |
| Found | Yes |
| Hash | 5fb23057a6b9726a81badee45e132d2f328ea727e6ac62a29e754ea413683634 |
| SimHash | 981e0c137377 |
Groups
zen_bot/2.0
| Rule | Path |
|---|---|
| Allow | *?utm_source= |
| Allow | *?from= |
| Allow | /rss-feeds/yanews.xml |
| Allow | /rss-feeds/yanews-webmaster.xml |
yandexnews
| Rule | Path |
|---|---|
| Allow | */yanews/ |
| Allow | /rss/yandex/ |
| Allow | *?from=yanews |
| Allow | *?utm_source= |
| Allow | /rss-feeds/yanews.xml |
| Allow | /rss-feeds/yanews-webmaster.xml |
*
| Rule | Path |
|---|---|
| Allow | /rss-feeds/yanews-webmaster.xml |
| Disallow | /*_openstat |
| Disallow | /*gclid%3D |
| Disallow | /*utm_source%3D |
| Disallow | /profile/* |
| Disallow | /user/* |
| Disallow | /admin/* |
| Disallow | /search/* |
| Disallow | /adv-p/* |
| Disallow | /static/__bannertest/* |
| Disallow | /main/ |
| Disallow | /mobile/$ |
| Disallow | /*/comments/ |
| Disallow | /jslog/* |
| Disallow | /push-subscribe/* |
| Disallow | *token%3D |
| Disallow | *google_preview%3D |
| Disallow | *oft_id%3D |
| Disallow | *sa%3D |
| Disallow | /undefined/* |
| Disallow | *affcode%3D |
| Disallow | *at%3D |
| Disallow | /javascript* |
| Disallow | *email%3D |
| Disallow | *pag%3D |
| Disallow | *?*utm |
| Disallow | *count%3D |
| Disallow | /static/ |
| Disallow | *popup-reg/ |
| Disallow | /comments/ |
| Disallow | /*?toComments |
| Disallow | *?previewToken=* |
| Disallow | /*?sort |
| Disallow | /*?ggep |
| Disallow | /*?tab |
| Disallow | /*?id |
| Disallow | /*?fsize |
| Disallow | /*?tags |
| Disallow | /*?backUrl |
| Disallow | /*?noredir |
| Disallow | /*?openGallery |
| Disallow | /gm-api/* |
| Disallow | */result/* |
| Disallow | *result%3D* |
| Disallow | /cabinet/login/ |
| Disallow | /? |
| Disallow | /horoscope/ |
| Disallow | /competition/ |
| Disallow | /forum/ |
| Disallow | /psychologies/ |
| Disallow | /cooking/ |
| Disallow | *?_gl |
| Disallow | */?$ |
| Disallow | */?page= |
| Disallow | */?erid= |
| Disallow | /*from%3D |
| Disallow | */?bulk_email_rid= |
| Disallow | */yanews/ |
| Disallow | /amp/ |
| Disallow | /s/ |
| Disallow | /gm-api/ |
| Disallow | /81006599/ |
| Disallow | /22729373807/ |
| Disallow | /tags/ |
| Disallow | /stil-zhizny/vibor-redakcii/beskontaktnaya-oplata-kak-rasplachivatsya-telefonom-posle-vvedeniya-sankcii/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://theday.ru/sitemaps/index.xml.gz |
Warnings
- `clean-param` is not a known field.