jp.rian.ru
robots.txt

Robots Exclusion Standard data for jp.rian.ru

Resource Scan

Scan Details

Site Domain jp.rian.ru
Base Domain rian.ru
Scan Status Ok
Last Scan2024-05-25T14:59:22+00:00
Next Scan 2024-06-24T14:59:22+00:00

Last Scan

Scanned2024-05-25T14:59:22+00:00
URL https://jp.rian.ru/robots.txt
Redirect https://sputniknews.jp/robots.txt
Redirect Domain sputniknews.jp
Redirect Base sputniknews.jp
Domain IPs 195.93.247.150
Redirect IPs 194.190.139.10
Response IP 194.190.139.10
Found Yes
Hash 7ec4f386eead2189f4df96d84f9c9d8f7a51bebc3f1d1044fe1b3fd81b21b92b
SimHash f80edd87a013

Groups

*

Rule Path
Disallow *-print.html$
Disallow /sys_*
Disallow /search/
Disallow /services/
Disallow /cms/
Disallow */calendar.html
Disallow /_editorial_preview_*

Other Records

Field Value
sitemap https://sputniknews.jp/sitemap_article_index.xml
sitemap https://sputniknews.jp/sitemap_list_index.xml
sitemap https://sputniknews.jp/sitemap_archive.xml

Warnings

  • `clean-param` is not a known field.