vesti.ru
robots.txt
Robots Exclusion Standard data for vesti.ru
Resource Scan
Scan Details
| Site Domain | vesti.ru |
| Base Domain | vesti.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-16T23:07:04+00:00 |
| Next Scan | 2024-11-23T23:07:04+00:00 |
Last Scan
| Scanned | 2024-11-16T23:07:04+00:00 |
| URL | https://vesti.ru/robots.txt |
| Redirect | https://www.vesti.ru/robots.txt |
| Redirect Domain | www.vesti.ru |
| Redirect Base | vesti.ru |
| Domain IPs | 178.248.232.222 |
| Redirect IPs | 178.248.232.222 |
| Response IP | 178.248.232.222 |
| Found | Yes |
| Hash | 468e10a9f64f92ba070fff9df3869c0538514013d8ed290affb7af6b168340f1 |
| SimHash | dcee44258871 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
| Disallow | /video/* |
| Disallow | /show/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | *?do=* |
| Disallow | *?route=* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
| Disallow | *?ysclid=* |
| Disallow | /?* |
| Disallow | /video/* |
| Disallow | /show/* |
| Disallow | *?nw=* |
| Disallow | *?hcb=* |
| Disallow | *?keepThis=* |
| Disallow | *?TB_iframe=* |
| Disallow | *?caption=* |
*
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
| Disallow | *?ysclid=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vesti.ru/sitemap.xml |
| sitemap | https://www.vesti.ru/sitemap.xml |
| sitemap | https://www.vesti.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.