autostat.ru
robots.txt
Robots Exclusion Standard data for autostat.ru
Resource Scan
Scan Details
| Site Domain | autostat.ru |
| Base Domain | autostat.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-10T18:31:44+00:00 |
| Next Scan | 2024-11-17T18:31:44+00:00 |
Last Scan
| Scanned | 2024-11-10T18:31:44+00:00 |
| URL | https://autostat.ru/robots.txt |
| Redirect | https://www.autostat.ru/robots.txt |
| Redirect Domain | www.autostat.ru |
| Redirect Base | autostat.ru |
| Domain IPs | 95.181.224.81 |
| Redirect IPs | 95.181.224.81 |
| Response IP | 95.181.224.81 |
| Found | Yes |
| Hash | 4b644937655e0addfbce8944954168189ed1e2d3b265f5063bd4de7519c3b62a |
| SimHash | 4d85485147b1 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /rss/_yandex.xml |
| Allow | /rss/rss_tags_yandex_turbo.xml |
| Allow | /rss/_rambler.xml |
| Allow | /residualvalue/$ |
| Disallow | /residualvalue/ |
| Disallow | /all/ |
| Disallow | /basket/ |
| Disallow | /help/ |
| Disallow | /pages/informacionnyi_razdel/novosti/gruppy_i_stranicy_avtostat_v_socialnyh_setyah/ |
| Disallow | /profile/ |
| Disallow | /radar_form/ |
| Disallow | /subscriptions/ |
| Disallow | */rss/ |
| Disallow | /? |
googlebot
| Rule | Path |
|---|---|
| Allow | /residualvalue/$ |
| Disallow | /residualvalue/ |
| Disallow | /all/ |
| Disallow | /basket/ |
| Disallow | /help/ |
| Disallow | /pages/informacionnyi_razdel/novosti/gruppy_i_stranicy_avtostat_v_socialnyh_setyah/ |
| Disallow | /profile/ |
| Disallow | /radar_form/ |
| Disallow | /subscriptions/ |
| Disallow | */rss/ |
| Disallow | /? |
*
| Rule | Path |
|---|---|
| Allow | /rss/_yandex.xml |
| Allow | /rss/rss_tags_yandex_turbo.xml |
| Allow | /residualvalue/$ |
| Disallow | /residualvalue/ |
| Disallow | /all/ |
| Disallow | /basket/ |
| Disallow | /help/ |
| Disallow | /pages/informacionnyi_razdel/novosti/gruppy_i_stranicy_avtostat_v_socialnyh_setyah/ |
| Disallow | /profile/ |
| Disallow | /radar_form/ |
| Disallow | /subscriptions/ |
| Disallow | */rss/ |
| Disallow | /? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autostat.ru/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.