agrogradt.com
robots.txt
Robots Exclusion Standard data for agrogradt.com
Resource Scan
Scan Details
| Site Domain | agrogradt.com |
| Base Domain | agrogradt.com |
| Scan Status | Ok |
| Last Scan | 2024-10-23T22:10:08+00:00 |
| Next Scan | 2024-11-22T22:10:08+00:00 |
Last Scan
| Scanned | 2024-10-23T22:10:08+00:00 |
| URL | https://agrogradt.com/robots.txt |
| Domain IPs | 2a03:6f00:1::5c35:7627, 92.53.118.39 |
| Response IP | 92.53.118.39 |
| Found | Yes |
| Hash | 42ca9fa1d9eb9a7e8394566508eb9a34bf778620e4147307e7187dc09f85e786 |
| SimHash | d11810c38e25 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | Стандартная папка на хостинге. |
| Disallow | /wp-admin/ | Закрываем админку. |
| Allow | /wp-admin/admin-ajax.php | Откроем аякс. |
| Disallow | /? | Все параметры запроса на главной. |
| Disallow | *?s= | Поиск. |
| Disallow | *%26s%3D | Поиск. |
| Disallow | /search | Поиск. |
| Disallow | /author/ | Архив автора. |
| Disallow | */embed$ | Все встраивания. |
| Disallow | */xmlrpc.php | Файл WordPress API |
| Disallow | *utm*%3D | Ссылки с utm-метками |
| Disallow | *openstat%3D | Ссылки с метками openstat |
| Disallow | *?add-to-cart | - |
| Disallow | *page* | - |
| Disallow | *wp-json* | - |
| Disallow | *?* | - |
| Disallow | *feed* | - |
| Disallow | *moskva* | - |
| Disallow | *sochi* | - |
| Disallow | *kazan* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://agrogradt.com/sitemap.xml |