my.mail.ru
robots.txt
Robots Exclusion Standard data for my.mail.ru
Resource Scan
Scan Details
| Site Domain | my.mail.ru |
| Base Domain | mail.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-09T10:44:30+00:00 |
| Next Scan | 2024-10-09T10:44:30+00:00 |
Last Scan
| Scanned | 2024-09-09T10:44:30+00:00 |
| URL | https://my.mail.ru/robots.txt |
| Domain IPs | 94.100.180.38 |
| Response IP | 94.100.180.38 |
| Found | Yes |
| Hash | 481bf93150b8b9bdd5481e3726264173cd3c519bfcb1fdc8f4771c3235a0925b |
| SimHash | 5b454ee0e1bd |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Allow | /cgi-bin/login |
| Disallow | /my/ |
| Allow | /my/communities |
| Allow | /my/video_channels_catalog |
| Allow | /*?page* |
| Disallow | /video/search |
| Disallow | */tag/ |
| Disallow | /*?from |
| Disallow | /*?ref=* |
| Disallow | /*?related_deep=* |
| Disallow | /*?time=* |
| Disallow | /*?parent=* |
| Disallow | /*?ps=* |
| Disallow | /*?skip=* |
| Disallow | /*?titles=* |
| Disallow | /*?reply=* |
| Disallow | /*?browse=* |
| Disallow | /*?thread=* |
| Disallow | /*?currentReferrer=* |
| Disallow | /*?backscreen_autoplay=* |
| Disallow | /music/*ref%3D |
| Disallow | /music/*ref_user%3D |
| Disallow | /music/play/ |
| Disallow | /music/*autoplay%3D |
| Disallow | /apps/*ref%3D |
| Disallow | /apps/search |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Allow | /cgi-bin/login |
| Disallow | /my/ |
| Allow | /my/communities |
| Allow | /my/video_channels_catalog |
| Allow | /*?page* |
| Disallow | /video/search |
| Disallow | */tag/ |
| Disallow | /*?from |
| Disallow | /*?ref=* |
| Disallow | /*?related_deep=* |
| Disallow | /*?time=* |
| Disallow | /*?parent=* |
| Disallow | /*?ps=* |
| Disallow | /*?skip=* |
| Disallow | /*?titles=* |
| Disallow | /*?reply=* |
| Disallow | /*?browse=* |
| Disallow | /*?thread=* |
| Disallow | /*?currentReferrer=* |
| Disallow | /*?backscreen_autoplay=* |
| Disallow | /music/*ref%3D |
| Disallow | /music/*ref_user%3D |
| Disallow | /music/play/ |
| Disallow | /music/*autoplay%3D |
| Disallow | /apps/*ref%3D |
| Disallow | /apps/search |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Allow | /cgi-bin/login |
| Disallow | /my/ |
| Allow | /my/communities |
| Allow | /my/video_channels_catalog |
| Allow | /*?page* |
| Disallow | /video/search |
| Disallow | */tag/ |
| Disallow | /*?from |
| Disallow | /*?ref=* |
| Disallow | /*?related_deep=* |
| Disallow | /*?time=* |
| Disallow | /*?parent=* |
| Disallow | /*?ps=* |
| Disallow | /*?skip=* |
| Disallow | /*?titles=* |
| Disallow | /*?reply=* |
| Disallow | /*?browse=* |
| Disallow | /*?thread=* |
| Disallow | /*?currentReferrer=* |
| Disallow | /*?backscreen_autoplay=* |
| Disallow | /music/*ref%3D |
| Disallow | /music/*ref_user%3D |
| Disallow | /music/play/ |
| Disallow | /music/*autoplay%3D |
| Disallow | /apps/*ref%3D |
| Disallow | /apps/search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://my.mail.ru/sitemap_users.xml |
| sitemap | https://my.mail.ru/sitemap_communities.xml |
| sitemap | https://my.mail.ru/sitemap_games.xml |
| sitemap | https://my.mail.ru/sitemap_video_yandex.xml |
| sitemap | https://my.mail.ru/sitemap_video_google.xml |
| sitemap | https://my.mail.ru/sitemap_music.xml |
| sitemap | https://my.mail.ru/sitemap_artists.xml |
| sitemap | https://my.mail.ru/sitemap_tracks.xml |
| sitemap | https://my.mail.ru/sitemap_users.xml |
| sitemap | https://my.mail.ru/sitemap_communities.xml |
| sitemap | https://my.mail.ru/sitemap_games.xml |
| sitemap | https://my.mail.ru/sitemap_video_yandex.xml |
| sitemap | https://my.mail.ru/sitemap_video_google.xml |
| sitemap | https://my.mail.ru/sitemap_music.xml |
| sitemap | https://my.mail.ru/sitemap_artists.xml |
| sitemap | https://my.mail.ru/sitemap_tracks.xml |
| sitemap | https://my.mail.ru/sitemap_users.xml |
| sitemap | https://my.mail.ru/sitemap_communities.xml |
| sitemap | https://my.mail.ru/sitemap_games.xml |
| sitemap | https://my.mail.ru/sitemap_video_yandex.xml |
| sitemap | https://my.mail.ru/sitemap_video_google.xml |
| sitemap | https://my.mail.ru/sitemap_music.xml |
| sitemap | https://my.mail.ru/sitemap_artists.xml |
| sitemap | https://my.mail.ru/sitemap_tracks.xml |
Warnings
- `host` is not a known field.