Log In Sign Up

runews24.ru
robots.txt

Robots Exclusion Standard data for runews24.ru

Resource Scan

Scan Details

Site Domain runews24.ru
Base Domain runews24.ru
Scan Status Ok
Last Scan2024-11-13T11:28:36+00:00
Next Scan 2024-11-20T11:28:36+00:00

Last Scan

Scanned2024-11-13T11:28:36+00:00
URL https://runews24.ru/robots.txt
Domain IPs 176.99.2.101
Response IP 176.99.2.101
Found Yes
Hash d7fccb8cc3ef1032d11d520e38d50ba68bff81a482c338e034ef38f66f03a7c4
SimHash 40504cc2cd11

Groups

*

Rule Path
Disallow /philip-morris
Disallow /manager/
Disallow /rezultatyi-poiska*
Disallow /eng/rezultatyi-poiska*
Disallow /*?page=*
Disallow /*?browser=*
Disallow /*?src=*
Disallow /*?utm
Disallow /bannerclick/
Disallow /ajaxres1
Disallow /eng/ajaxres1
Disallow /ajaxres2
Disallow /eng/ajaxres2
Disallow /get-lastnews.htm
Disallow /eng/get-lastnews.htm
Disallow /ajax_archive.json
Disallow /eng/ajax_archive.json

yandex

Rule Path
Disallow /philip-morris
Disallow /manager/
Disallow /rezultatyi-poiska*
Disallow /*?page=*
Disallow /*?browser=*
Disallow /*?src=*
Disallow /*?utm
Disallow /bannerclick/
Disallow /amp/*
Allow /zennews.xml

googlebot

Rule Path
Disallow /philip-morris
Disallow /manager/
Disallow /rezultatyi-poiska*
Disallow /*?page=*
Disallow /*?browser=*
Disallow /*?src=*
Disallow /*?utm
Disallow /bannerclick/

trendkite-akashic-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://runews24.ru/sitemap.xml
sitemap https://runews24.ru/sitemap.xml
sitemap https://runews24.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top