news.zerkalo.io
robots.txt

Robots Exclusion Standard data for news.zerkalo.io

Resource Scan

Scan Details

Site Domain news.zerkalo.io
Base Domain zerkalo.io
Scan Status Ok
Last Scan2024-11-08T17:29:53+00:00
Next Scan 2024-11-15T17:29:53+00:00

Last Scan

Scanned2024-11-08T17:29:53+00:00
URL https://news.zerkalo.io/robots.txt
Domain IPs 104.27.202.88, 104.27.203.88, 2606:4700:21::681b:ca58, 2606:4700:21::681b:cb58
Response IP 104.27.202.88
Found Yes
Hash 6ca2b32abd071c718d32b57d91e556cb8bc390f0776e304eab9c95a55a72b572
SimHash 4b48cad65331

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

yandex

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://news.zerkalo.io/sitemap.xml

Warnings

  • `host` is not a known field.