ru.sputnik.md
robots.txt

Robots Exclusion Standard data for ru.sputnik.md

Resource Scan

Scan Details

Site Domain ru.sputnik.md
Base Domain sputnik.md
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-06T21:51:16+00:00
Next Scan 2025-01-04T21:51:16+00:00

Last Successful Scan

Scanned2022-02-22T01:57:48+00:00
URL https://ru.sputnik.md/robots.txt
Response IP 178.248.234.83
Found Yes
Hash 1b0a899c48f46bc766bc3f48de5bfed293ce6e2bee3f0d8a1a1dfc1ec6ec66e2
SimHash 3cd89d07a283

Groups

*

Rule Path
Disallow *-print.html$
Disallow /sys_*
Disallow /search/
Disallow /services/
Disallow /cms/
Disallow */calendar.html
Disallow /_editorial_preview_*
Disallow /files/
Disallow */more.html

Other Records

Field Value
sitemap https://ru.sputnik.md/sitemap_article_index.xml
sitemap https://ru.sputnik.md/sitemap_list_index.xml
sitemap https://ru.sputnik.md/sitemap_archive.xml

Warnings

  • `clean-param` is not a known field.