news-w.org
robots.txt
Robots Exclusion Standard data for news-w.org
Resource Scan
Scan Details
| Site Domain | news-w.org |
| Base Domain | news-w.org |
| Scan Status | Ok |
| Last Scan | 2025-04-03T07:47:54+00:00 |
| Next Scan | 2025-04-10T07:47:54+00:00 |
Last Scan
| Scanned | 2025-04-03T07:47:54+00:00 |
| URL | https://news-w.org/robots.txt |
| Domain IPs | 195.24.68.4 |
| Response IP | 195.24.68.4 |
| Found | Yes |
| Hash | 32821d4add87c2a831d4059535f29323175134eda08941b8bd286571112e5305 |
| SimHash | 7c05384aaa33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /tags/ |
| Disallow | /lastnews/page/ |
| Disallow | /vse-novosti/print |
| Disallow | /avto/page/ |
| Disallow | /ekonomika/page/ |
| Disallow | /zdravoohranenie/page/ |
| Disallow | /tehnologii/page/ |
| Disallow | /nedvizhimost/page/ |
| Disallow | /inopressa/page |
| Disallow | /mil/page/ |
| Disallow | /region/page/ |
| Disallow | /sport/page/ |
| Disallow | /kultura/page/ |
| Disallow | /kriminal/page/ |
| Disallow | /novosti-moskva/page/ |
| Disallow | /mir/page/ |
| Disallow | /russia/page/ |
| Disallow | /politika/page/ |
| Disallow | /afisha/page/ |
| Disallow | /tourism/page/ |
| Disallow | /kino/page/ |
| Disallow | /den-varenya/page/ |
| Disallow | /muzyka/page/ |
| Disallow | /kafe_bar_rastoran_pub/page/ |
| Disallow | /hronika_svet/page/ |
| Disallow | /vse-novosti/page/ |
| Disallow | /exclusive/page/ |
| Disallow | /moda/page/ |
| Disallow | /specialnyy-reportazh/page/ |
| Disallow | /page/ |
| Disallow | /2014/ |
| Disallow | /2015/ |
| Disallow | /2016/ |
| Disallow | /2017/ |
| Disallow | /2018/ |
| Disallow | /2019/ |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.news-w.org/sitemap.xml |
Warnings
- `host` is not a known field.