гугле.рф
robots.txt
Robots Exclusion Standard data for гугле.рф
Resource Scan
Scan Details
| Site Domain | гугле.рф |
| Base Domain | гугле.рф |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-05T19:25:43+00:00 |
| Next Scan | 2025-01-03T19:25:43+00:00 |
Last Successful Scan
| Scanned | 2022-03-01T19:15:33+00:00 |
| URL | https://гугле.рф/robots.txt |
| Redirect | https://xn--c1aagx2b.xn--p1ai/robots.txt |
| Response IP | 185.154.54.3 |
| Found | Yes |
| Hash | b8b1c760cf7a742fafe8075c5036cbeff0f87c5cd53a76fd6b88364a4e67361d |
| SimHash | 3194125f8475 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /article_email/* |
| Disallow | /user/* |
| Disallow | /pdf/documents/* |
| Disallow | /login/* |
| Disallow | /acct/* |
| Disallow | /msgcenter/* |
| Disallow | /setup/* |
| Disallow | /marketing/* |
| Disallow | /public/article/* |
| Disallow | /public/search/ |
| Disallow | /public/search* |
| Disallow | /search* |
| Disallow | /public/page/wsj-x-marketing.html |
| Disallow | /public/page/news-media-marketing.html |
| Disallow | /public/page/0_0_WP_RT_MARKETING.html |
| Disallow | /news/articles/SB2* |
| Disallow | /news/articles/SB3* |
| Disallow | /news/articles/SB4* |
| Disallow | /articles/SB2* |
| Disallow | /articles/SB3* |
| Disallow | /articles/SB4* |
| Disallow | /article/AP* |
| Disallow | /article/BT-CO* |
| Disallow | /article/DN-CO* |
| Disallow | /article/PR-CO* |
| Disallow | /article/HUG* |
| Disallow | /video/search/* |
| Disallow | /articles/BT-CO* |
| Disallow | /articles/DN-CO* |
| Disallow | /articles/PR-CO* |
| Disallow | /news/articles/BT-CO* |
| Disallow | /news/articles/DN-CO* |
| Disallow | /news/articles/PR-CO* |
| Disallow | /catchup/* |
| Disallow | /articles/the-meaning-behind-juneteenth-11592413234 |
| Disallow | /emailservice/* |
| Disallow | /emailsignup/* |
| Disallow | /insetsrv/v1/* |
| Disallow | /user/fpd/api/* |
msnptc/1.0
| Rule | Path |
|---|---|
| Disallow | /article_email/* |
| Disallow | /login/* |
| Disallow | /acct/* |
| Disallow | /msgcenter/* |
| Disallow | /setup/* |
| Disallow | /user/* |
| Disallow | /marketing/* |
| Disallow | /public/article/* |
| Disallow | /public/search/ |
| Disallow | /public/search* |
| Disallow | /search* |
| Disallow | /public/page/wsj-x-marketing.html |
| Disallow | /public/page/news-media-marketing.html |
| Disallow | /public/page/0_0_WP_RT_MARKETING.html |
| Disallow | /news/articles/SB2* |
| Disallow | /news/articles/SB3* |
| Disallow | /news/articles/SB4* |
| Disallow | /articles/SB2* |
| Disallow | /articles/SB3* |
| Disallow | /articles/SB4* |
| Disallow | /article/AP* |
| Disallow | /article/BT-CO* |
| Disallow | /article/DN-CO* |
| Disallow | /article/PR-CO* |
| Disallow | /article/HUG* |
| Disallow | /video/search/* |
| Disallow | /articles/BT-CO* |
| Disallow | /articles/DN-CO* |
| Disallow | /articles/PR-CO* |
| Disallow | /news/articles/BT-CO* |
| Disallow | /news/articles/DN-CO* |
| Disallow | /news/articles/PR-CO* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vidsave.ru/sitemap.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_google_news.xml |
| sitemap | https://vidsave.ru/sitemap_topics.xml |
| sitemap | https://vidsave.ru/sitemaps/web/wsj/en/sitemap_wsj_en_index.xml |
| sitemap | https://vidsave.ru/live_news_sitemap.xml |
| sitemap | https://vidsave.ru/wsj_graphics_sitemap.xml |
| sitemap | https://vidsave.ru/sitemaps/web/wsj/en/sitemap_news_archive_index.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_article_types.xml |
| sitemap | https://vidsave.ru/authors_sitemap.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_article_list_sitemap.xml |
| sitemap | https://vidsave.ru/api-video/sitemaps/google/sitemap-google-news-video-wsj-en.asp |
| sitemap | https://vidsave.ru/api-video/sitemaps/google/sitemap-google-video-wsj-en.asp |
| sitemap | https://vidsave.ru/sitemaps/web/video/en/sitemap_video_en_index.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_cb_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_ai_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_debt_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_cyber_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_vc_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_pe_google_news.xml |
| sitemap | https://vidsave.ru/wsjsitemaps/wsj_pro_sb_google_news.xml |
| sitemap | https://vidsave.ru/coupons/sitemap.xml |