vse42.ru
robots.txt
Robots Exclusion Standard data for vse42.ru
Resource Scan
Scan Details
| Site Domain | vse42.ru |
| Base Domain | vse42.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-20T18:06:18+00:00 |
| Next Scan | 2024-09-27T18:06:18+00:00 |
Last Scan
| Scanned | 2024-09-20T18:06:18+00:00 |
| URL | https://vse42.ru/robots.txt |
| Domain IPs | 31.131.251.209 |
| Response IP | 31.131.251.209 |
| Found | Yes |
| Hash | d58e574fae97b14a8ea4049e4030f36474f1563e05815518dbdd510b53cb1d19 |
| SimHash | 2950b920b3d6 |
Groups
yandexbot
| Rule | Path |
|---|---|
| Disallow | /index/top |
| Disallow | /feed/rss* |
| Disallow | /feed/search* |
| Disallow | /profile* |
| Disallow | /common/index/tags* |
| Disallow | /*?admakets=show |
| Disallow | /*?admakets=hide |
| Disallow | /*?info=* |
| Disallow | /health* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /index/top |
| Disallow | /feed/rss* |
| Disallow | /feed/search* |
| Disallow | /profile* |
| Disallow | /common/index/tags* |
| Disallow | /*?admakets=show |
| Disallow | /*?admakets=hide |
| Disallow | /*?info=* |
| Disallow | /health* |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /index/top |
| Disallow | /feed/rss* |
| Disallow | /feed/search/* |
| Disallow | /profile* |
| Disallow | /common/index/tags* |
| Disallow | /*?admakets=show |
| Disallow | /*?admakets=hide |
| Disallow | /*?info=* |
| Disallow | /health* |