jp.sputniknews.com
robots.txt

Robots Exclusion Standard data for jp.sputniknews.com

Resource Scan

Scan Details

Site Domain jp.sputniknews.com
Base Domain sputniknews.com
Scan Status Ok
Last Scan2024-11-12T01:21:43+00:00
Next Scan 2024-11-19T01:21:43+00:00

Last Scan

Scanned2024-11-12T01:21:43+00:00
URL https://jp.sputniknews.com/robots.txt
Redirect https://sputniknews.jp/robots.txt
Redirect Domain sputniknews.jp
Redirect Base sputniknews.jp
Domain IPs 194.190.139.10
Redirect IPs 194.190.139.10
Response IP 194.190.139.10
Found Yes
Hash 7ec4f386eead2189f4df96d84f9c9d8f7a51bebc3f1d1044fe1b3fd81b21b92b
SimHash f80edd87a013

Groups

*

Rule Path
Disallow *-print.html$
Disallow /sys_*
Disallow /search/
Disallow /services/
Disallow /cms/
Disallow */calendar.html
Disallow /_editorial_preview_*

Other Records

Field Value
sitemap https://sputniknews.jp/sitemap_article_index.xml
sitemap https://sputniknews.jp/sitemap_list_index.xml
sitemap https://sputniknews.jp/sitemap_archive.xml

Warnings

  • `clean-param` is not a known field.