novyny.pro
robots.txt
Robots Exclusion Standard data for novyny.pro
Resource Scan
Scan Details
| Site Domain | novyny.pro |
| Base Domain | novyny.pro |
| Scan Status | Ok |
| Last Scan | 2026-01-24T17:30:13+00:00 |
| Next Scan | 2026-01-31T17:30:13+00:00 |
Last Scan
| Scanned | 2026-01-24T17:30:13+00:00 |
| URL | https://novyny.pro/robots.txt |
| Domain IPs | 104.26.12.109, 104.26.13.109, 172.67.74.237, 2606:4700:20::681a:c6d, 2606:4700:20::681a:d6d, 2606:4700:20::ac43:4aed |
| Response IP | 172.67.74.237 |
| Found | Yes |
| Hash | e010c9243eb77ef5dacdd638550e5c6f4ba1a38aaa6dcf80949d2efb70516a98 |
| SimHash | 655c1d426db0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_block/ |
| Disallow | /_page/ |
| Disallow | /quiz_get/ |
| Disallow | /media/get/ |
| Disallow | /news/view/inc/ |
| Disallow | /ru/news/view/inc/ |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://novyny.pro/sitemap/sitemap.xml |
| sitemap | https://novyny.pro/xml/gnews_new.xml |
| sitemap | https://novyny.pro/ru/xml/gnews_new.xml |