mignews.ua
robots.txt

Robots Exclusion Standard data for mignews.ua

Resource Scan

Scan Details

Site Domain mignews.ua
Base Domain mignews.ua
Scan Status Ok
Last Scan4/5/2025, 12:31:59 PM
Next Scan 4/12/2025, 12:31:59 PM

Last Scan

Scanned4/5/2025, 12:31:59 PM
URL https://mignews.ua/robots.txt
Domain IPs 104.21.16.115, 172.67.212.8, 2606:4700:3032::6815:1073, 2606:4700:3037::ac43:d408
Response IP 104.21.16.115
Found Yes
Hash 2ac88e00c4490b58428c8220cf88d244f111cf790078a94a6abfc4d5c69f6c74
SimHash 4d1580e6b7d1

Groups

yandex

Rule Path
Disallow /aadm

yandeximages

Rule Path
Disallow /aadm

googlebot

Rule Path
Allow /js
Disallow /aadm

googlebot-image

Rule Path
Disallow /aadm

facebot

Rule Path
Disallow /aadm

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow /aadm

*

Rule Path
Disallow /cdn-cgi/

amazonbot

Rule Path
Disallow /

amazon adbot

Rule Path
Disallow /

amazon contxbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mignews.ua/sitemap.xml

Warnings

  • `host` is not a known field.