azberg.ru
robots.txt
Robots Exclusion Standard data for azberg.ru
Resource Scan
Scan Details
| Site Domain | azberg.ru |
| Base Domain | azberg.ru |
| Scan Status | Ok |
| Last Scan | 2026-01-23T00:58:45+00:00 |
| Next Scan | 2026-02-22T00:58:45+00:00 |
Last Scan
| Scanned | 2026-01-23T00:58:45+00:00 |
| URL | https://azberg.ru/robots.txt |
| Domain IPs | 87.236.16.91 |
| Response IP | 87.236.16.91 |
| Found | Yes |
| Hash | 15370e0e67e5c203c3025b82c8f34d86f201d54c1f22a461d253d1c5c96294ba |
| SimHash | 394ca4eac592 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /favorites/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | */page/* |
| Disallow | /engine/ |
| Disallow | /language/ |
| Disallow | /templates/ |
| Disallow | /backup/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /catalog/ |
| Disallow | /tags/ |
| Disallow | /autobackup.php |
| Disallow | /ramziladmin.php |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /rules.html |
| Disallow | /dle-rules-page.html |
| Disallow | /banners/ |
| Disallow | /user/ |
| Disallow | /20* |
| Disallow | /*?* |
yandex
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /favorites/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | */page/* |
| Disallow | /engine/ |
| Disallow | /language/ |
| Disallow | /templates/ |
| Disallow | /backup/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /catalog/ |
| Disallow | /tags/ |
| Disallow | /autobackup.php |
| Disallow | /ramziladmin.php |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /rules.html |
| Disallow | /dle-rules-page.html |
| Disallow | /banners/ |
| Disallow | /user/ |
| Disallow | /20* |
| Disallow | /*?* |
google
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /favorites/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | */page/* |
| Disallow | /engine/ |
| Disallow | /language/ |
| Disallow | /templates/ |
| Disallow | /backup/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /catalog/ |
| Disallow | /tags/ |
| Disallow | /autobackup.php |
| Disallow | /ramziladmin.php |
| Disallow | /statistics.html |
| Disallow | /addnews.html |
| Disallow | /rules.html |
| Disallow | /dle-rules-page.html |
| Disallow | /banners/ |
| Disallow | /user/ |
| Disallow | /20* |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://azberg.ru/sitemap.xml |
| sitemap | https://azberg.ru/sitemap.xml |
Warnings
- `host` is not a known field.