vesti.ru
robots.txt
Robots Exclusion Standard data for vesti.ru
Resource Scan
Scan Details
| Site Domain | vesti.ru |
| Base Domain | vesti.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-21T17:08:39+00:00 |
| Next Scan | 2024-09-28T17:08:39+00:00 |
Last Scan
| Scanned | 2024-09-21T17:08:39+00:00 |
| URL | https://vesti.ru/robots.txt |
| Redirect | https://www.vesti.ru/robots.txt |
| Redirect Domain | www.vesti.ru |
| Redirect Base | vesti.ru |
| Domain IPs | 178.248.232.222 |
| Redirect IPs | 178.248.232.222 |
| Response IP | 178.248.232.222 |
| Found | Yes |
| Hash | 91038b8f53148974acc5f18c0694a7a975f507fc74f58fd0cb8ef260f1e0f6ff |
| SimHash | dd804415a051 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
| Disallow | *?ysclid=* |
*
| Rule | Path |
|---|---|
| Disallow | /article/2540410 |
| Disallow | /article/2541703 |
| Disallow | /article/2541686 |
| Disallow | /article/2541703 |
| Disallow | *p%3D* |
| Disallow | *id%3D* |
| Disallow | *cid%3D* |
| Disallow | *sid%3D* |
| Disallow | *tid%3D* |
| Disallow | *?ref=* |
| Disallow | *browser%3D* |
| Disallow | *ldate%3D* |
| Disallow | *date%3D* |
| Disallow | *?amp* |
| Disallow | /search?* |
| Disallow | /news?* |
| Disallow | /nauka?* |
| Disallow | /hitech?* |
| Disallow | /auto?* |
| Disallow | /television?* |
| Disallow | /pensia?* |
| Disallow | /finance?* |
| Disallow | /sport?* |
| Disallow | /video?* |
| Disallow | *?ysclid=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vesti.ru/sitemap.xml |
| sitemap | https://www.vesti.ru/sitemap.xml |
| sitemap | https://www.vesti.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.