mobiltelefon.ru
robots.txt
Robots Exclusion Standard data for mobiltelefon.ru
Resource Scan
Scan Details
| Site Domain | mobiltelefon.ru |
| Base Domain | mobiltelefon.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-23T03:26:58+00:00 |
| Next Scan | 2024-09-30T03:26:58+00:00 |
Last Scan
| Scanned | 2024-09-23T03:26:58+00:00 |
| URL | https://mobiltelefon.ru/robots.txt |
| Domain IPs | 89.253.229.31 |
| Response IP | 89.253.229.31 |
| Found | Yes |
| Hash | eddec3fd3ad37b1682884911cebfe43286c26cabee43f1324ddd5adcb7939cf1 |
| SimHash | 4fe19bb9d283 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /stat |
| Disallow | /search |
| Disallow | */stat*.html |
| Disallow | */search*.html |
| Disallow | */comment_ |
| Disallow | */page_all_ |
| Disallow | /en/ |
| Disallow | /http |
| Disallow | /*.shtml |
| Disallow | /*price/ |
| Disallow | /*send-to-friend |
| Disallow | */page_releases_*.html |
| Disallow | */index_obzor.html |
| Disallow | */index_main.html |
| Disallow | */index_all.html |
| Disallow | */index_soft.html |
| Disallow | */index_blog.html |
| Disallow | */index_video.html |
| Disallow | */contents_all.html |
| Disallow | */contents_main.html |
| Disallow | */contents_obzor.html |
| Disallow | */contents_soft.html |
| Disallow | */contents_blog.html |
| Disallow | */contents_video.html |
| Disallow | */search.html |
| Disallow | */rss_comments.html |
| Disallow | */index_a.html |
| Disallow | */index_b.html |
| Disallow | */index_c.html |
| Disallow | */index_d.html |
| Disallow | */inspector.html |
| Disallow | */login.html |
| Disallow | */postedit*.html |
| Disallow | */connect_*.html |
| Disallow | */index2536080.php |
| Disallow | */index2536081.php |
| Disallow | /tmp/demo/index*.php |
| Disallow | /tmp/demo_v2/ |
| Disallow | /games/ |
| Disallow | /blog/ |
| Disallow | /video/ |
| Disallow | /reviews/ |
| Disallow | /other/ |
*
| Rule | Path |
|---|---|
| Disallow | /stat |
| Disallow | /search |
| Disallow | */stat*.html |
| Disallow | */search*.html |
| Disallow | */comment_ |
| Disallow | */page_all_ |
| Disallow | /en/ |
| Disallow | /http |
| Disallow | /*.shtml |
| Disallow | /*price/ |
| Disallow | /*send-to-friend |
| Disallow | */page_releases_*.html |
| Disallow | */index_obzor.html |
| Disallow | */index_main.html |
| Disallow | */index_all.html |
| Disallow | */index_soft.html |
| Disallow | */index_blog.html |
| Disallow | */index_video.html |
| Disallow | */contents_all.html |
| Disallow | */contents_main.html |
| Disallow | */contents_obzor.html |
| Disallow | */contents_soft.html |
| Disallow | */contents_blog.html |
| Disallow | */contents_video.html |
| Disallow | */search.html |
| Disallow | */rss_comments.html |
| Disallow | */index_a.html |
| Disallow | */index_b.html |
| Disallow | */index_c.html |
| Disallow | */index_d.html |
| Disallow | */inspector.html |
| Disallow | */login.html |
| Disallow | */postedit*.html |
| Disallow | */connect_*.html |
| Disallow | */index2536080.php |
| Disallow | */index2536081.php |
| Disallow | /tmp/demo/index*.php |
| Disallow | /tmp/demo_v2/ |
| Disallow | /games/ |
| Disallow | /blog/ |
| Disallow | /video/ |
| Disallow | /reviews/ |
| Disallow | /other/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |