zahleb.me
robots.txt
Robots Exclusion Standard data for zahleb.me
Resource Scan
Scan Details
| Site Domain | zahleb.me |
| Base Domain | zahleb.me |
| Scan Status | Ok |
| Last Scan | 2024-11-08T01:15:15+00:00 |
| Next Scan | 2024-11-15T01:15:15+00:00 |
Last Scan
| Scanned | 2024-11-08T01:15:15+00:00 |
| URL | https://zahleb.me/robots.txt |
| Domain IPs | 139.162.220.220 |
| Response IP | 139.162.220.220 |
| Found | Yes |
| Hash | 67a4e3766650cb64103d29878ac42314a3e4e5de3fa9bf018df4c171e95ad95b |
| SimHash | 6dc58c4789fc |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /search?q=* |
| Disallow | /?referrer=* |
| Disallow | /?_branch_match_id=* |
| Disallow | /en/search?q=* |
| Disallow | /ru/search?q=* |
| Disallow | /buy_premium |
| Disallow | /signIn?from=%2Fworks |
| Disallow | /works |
| Disallow | /profile |
| Disallow | /docs/* |
| Disallow | /profile/reading |
| Disallow | /profile/read |
| Disallow | /signIn |
| Disallow | /ru/* |
| Disallow | /ru? |
| Disallow | /?operation_status=* |
| Disallow | /?spush=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?native.theme=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?night=* |
| Disallow | /?~click_id=* |
| Disallow | /?_x_tr_sl=* |
| Disallow | /en/profile/* |
| Disallow | /?from=* |
| Disallow | /?target=* |
| Allow | /story/* |
| Allow | /author/* |
| Allow | /categories/* |
| Allow | /category/* |
| Allow | /tag/* |
| Allow | /stories/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /search?q=* |
| Disallow | /?referrer=* |
| Disallow | /?_branch_match_id=* |
| Disallow | /en/search?q=* |
| Disallow | /ru/search?q=* |
| Disallow | /buy_premium |
| Disallow | /signIn?from=%2Fworks |
| Disallow | /works |
| Disallow | /profile |
| Disallow | /docs/* |
| Disallow | /profile/reading |
| Disallow | /profile/read |
| Disallow | /signIn |
| Disallow | /ru/* |
| Disallow | /ru? |
| Disallow | /?operation_status=* |
| Disallow | /?spush=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?native.theme=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?night=* |
| Disallow | /?~click_id=* |
| Disallow | /?_x_tr_sl=* |
| Disallow | /en/profile/* |
| Disallow | /?from=* |
| Disallow | /?target=* |
| Allow | /story/* |
| Allow | /author/* |
| Allow | /categories/* |
| Allow | /category/* |
| Allow | /tag/* |
| Allow | /stories/* |
*
| Rule | Path |
|---|---|
| Disallow | /search?q=* |
| Disallow | /?referrer=* |
| Disallow | /?_branch_match_id=* |
| Disallow | /en/search?q=* |
| Disallow | /ru/search?q=* |
| Disallow | /buy_premium |
| Disallow | /signIn?from=%2Fworks |
| Disallow | /works |
| Disallow | /profile |
| Disallow | /docs/* |
| Disallow | /profile/reading |
| Disallow | /profile/read |
| Disallow | /signIn |
| Disallow | /ru/* |
| Disallow | /ru? |
| Disallow | /?operation_status=* |
| Disallow | /?spush=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?native.theme=* |
| Disallow | /?serviceId=* |
| Disallow | /ru?night=* |
| Disallow | /?~click_id=* |
| Disallow | /?_x_tr_sl=* |
| Disallow | /en/profile/* |
| Disallow | /?from=* |
| Disallow | /?target=* |
| Allow | /story/* |
| Allow | /author/* |
| Allow | /categories/* |
| Allow | /category/* |
| Allow | /tag/* |
| Allow | /stories/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://zahleb.me/sitemap.xml |
| sitemap | https://zahleb.me/sitemap.xml |
| sitemap | https://zahleb.me/sitemap.xml |
Warnings
- `host` is not a known field.