am.sputniknews.ru
robots.txt

Robots Exclusion Standard data for am.sputniknews.ru

Resource Scan

Scan Details

Site Domain am.sputniknews.ru
Base Domain sputniknews.ru
Scan Status Ok
Last Scan2024-10-06T04:09:15+00:00
Next Scan 2024-10-13T04:09:15+00:00

Last Scan

Scanned2024-10-06T04:09:15+00:00
URL https://am.sputniknews.ru/robots.txt
Domain IPs 194.190.139.19
Response IP 194.190.139.19
Found Yes
Hash 0f0c2c0f847be4b30a3d6603ec0c636aa73a26e98e62ddd733bf8d82e1ec4cae
SimHash 7c2b8d87c713

Groups

*

Rule Path
Disallow *-print.html$
Disallow /sys_*
Disallow /search/
Disallow /services/
Disallow /cms/
Disallow */calendar.html
Disallow /_editorial_preview_*
Disallow /files/
Disallow */more.html
Disallow /ig/

Other Records

Field Value
sitemap https://am.sputniknews.ru/sitemap_article_index.xml
sitemap https://am.sputniknews.ru/sitemap_list_index.xml
sitemap https://am.sputniknews.ru/sitemap_archive.xml

Warnings

  • `clean-param` is not a known field.