haberlan.ru
robots.txt
Robots Exclusion Standard data for haberlan.ru
Resource Scan
Scan Details
| Site Domain | haberlan.ru |
| Base Domain | haberlan.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-09T03:51:44+00:00 |
| Next Scan | 2024-10-09T03:51:44+00:00 |
Last Scan
| Scanned | 2024-09-09T03:51:44+00:00 |
| URL | https://haberlan.ru/robots.txt |
| Domain IPs | 188.225.37.29 |
| Response IP | 188.225.37.29 |
| Found | Yes |
| Hash | 33b6d5a2804c96e2580f4a0acd2da127b72668f54a5b80738f8732206333d5ef |
| SimHash | 26788d714a0b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /files/ |
| Disallow | /search |
| Disallow | /policy |
| Disallow | /guide |
| Disallow | /lk/ |
| Disallow | /*?*= |
| Disallow | /*%26 |
| Disallow | /index.php$ |
| Disallow | /index$ |
| Disallow | /tg.php |
| Disallow | /export-about |
Other Records
| Field | Value |
|---|---|
| sitemap | https://haberlan.ru/sitemap.xml |