covid-en.osnova.news
robots.txt

Robots Exclusion Standard data for covid-en.osnova.news

Resource Scan

Scan Details

Site Domain covid-en.osnova.news
Base Domain osnova.news
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-08T15:54:30+00:00
Next Scan 2024-12-07T15:54:30+00:00

Last Successful Scan

Scanned2022-07-24T23:51:37+00:00
URL https://covid-en.osnova.news/robots.txt
Response IP 178.208.83.45
Found Yes
Hash 0d9be51b0ef70188d5dee5680c5ea02936b6d66bb02fa751226761a6c85c769b
SimHash 4b48cc008392

Groups

*

Rule Path
Disallow /cron/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow

Other Records

Field Value
sitemap https://covid-en.osnova.news/feed/sitemap.xml

Warnings

  • `host` is not a known field.