aesp.ru
robots.txt
Robots Exclusion Standard data for aesp.ru
Resource Scan
Scan Details
| Site Domain | aesp.ru |
| Base Domain | aesp.ru |
| Scan Status | Ok |
| Last Scan | 2025-04-07T10:27:47+00:00 |
| Next Scan | 2025-05-07T10:27:47+00:00 |
Last Scan
| Scanned | 2025-04-07T10:27:47+00:00 |
| URL | https://aesp.ru/robots.txt |
| Domain IPs | 188.225.40.227 |
| Response IP | 188.225.40.227 |
| Found | Yes |
| Hash | ddd96fc4c37f43213cd2e8d55e4626a3de0c4607da9b65a6439ff28216dd5977 |
| SimHash | c404df42e533 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /bitrix/ | - |
| Disallow | /search/ | - |
| Disallow | /awstats/ | - |
| Disallow | /partner/ | - |
| Allow | /search/map.php | - |
| Disallow | /auth/ | - |
| Disallow | /auth.php | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*BACKURL%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*BACK_URL%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aesp.ru/sitemap.xml |
Warnings
- `host` is not a known field.