top2.by
robots.txt
Robots Exclusion Standard data for top2.by
Resource Scan
Scan Details
| Site Domain | top2.by |
| Base Domain | top2.by |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-31T08:00:13+00:00 |
| Next Scan | 2026-03-31T08:00:13+00:00 |
Last Successful Scan
| Scanned | 2025-06-04T22:04:29+00:00 |
| URL | https://top2.by/robots.txt |
| Domain IPs | 178.172.245.34 |
| Response IP | 178.172.245.34 |
| Found | Yes |
| Hash | 2c2c541d259b5fc846e10d1d172cec8d6dcb7018fe9af643f63a9c3e65c53eab |
| SimHash | af1ccf5141f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /tmp/ |
| Disallow | *?option=com_search |
| Disallow | *?option=com_newsfeeds |
| Disallow | *?option=com_wrapper |
| Disallow | *?option=com_finder |
| Disallow | *%26option%3Dcom_finder |
| Disallow | *?format=raw |
| Disallow | *%26format%3Draw |
| Disallow | *%26tmpl%3Dcomponent |
| Disallow | *?tmpl=component |
| Disallow | /php/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://top2.by/sitemap.xml |
Warnings
- `host` is not a known field.