select.by
robots.txt
Robots Exclusion Standard data for select.by
Resource Scan
Scan Details
| Site Domain | select.by |
| Base Domain | select.by |
| Scan Status | Ok |
| Last Scan | 2024-09-28T11:46:34+00:00 |
| Next Scan | 2024-10-05T11:46:34+00:00 |
Last Scan
| Scanned | 2024-09-28T11:46:34+00:00 |
| URL | https://select.by/robots.txt |
| Domain IPs | 45.135.234.46 |
| Response IP | 45.135.234.46 |
| Found | Yes |
| Hash | 4c062268b80e79f1121cf364a94c8f5e524bb2ef6e0e804fdd3942eb91de8df3 |
| SimHash | 092c806461d8 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /autocr/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /includes/ |
| Disallow | /informer/ |
| Disallow | /language/ |
| Disallow | /logs/ |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /installation/ |
| Disallow | /_foto/ |
| Disallow | /courses/ |
| Disallow | /online/ |
| Disallow | /online_kredit/ |
| Disallow | /credit/ |
| Disallow | /openads/ |
| Disallow | /openx/ |
| Disallow | /sxd/ |
| Disallow | /tablesort/ |
| Disallow | /templates/ |
| Disallow | /test/ |
| Disallow | /tmp/ |
| Disallow | /vendor/ |
| Disallow | /current/ |
| Disallow | /api/ |
| Allow | /css/ |
| Allow | /images/ |
| Allow | /js/ |
| Allow | /images/ |
| Allow | /includes/js/ |
| Allow | /templates/select_by7/scripts/ |
| Allow | /templates/select_by7/css/ |
| Allow | /mambots/content/stock/ |
| Allow | /components/com_news_portal/ |
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /autocr/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /includes/ |
| Disallow | /informer/ |
| Disallow | /language/ |
| Disallow | /logs/ |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /installation/ |
| Disallow | /_foto/ |
| Disallow | /courses/ |
| Disallow | /online/ |
| Disallow | /online_kredit/ |
| Disallow | /credit/ |
| Disallow | /openads/ |
| Disallow | /openx/ |
| Disallow | /sxd/ |
| Disallow | /tablesort/ |
| Disallow | /templates/ |
| Disallow | /test/ |
| Disallow | /tmp/ |
| Disallow | /vendor/ |
| Disallow | /current/ |
| Disallow | /api/ |
| Allow | /css/ |
| Allow | /images/ |
| Allow | /js/ |
| Allow | /images/ |
| Allow | /includes/js/ |
| Allow | /templates/select_by7/scripts/ |
| Allow | /templates/select_by7/css/ |
| Allow | /mambots/content/stock/ |
| Allow | /components/com_news_portal/ |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /autocr/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /includes/ |
| Disallow | /informer/ |
| Disallow | /language/ |
| Disallow | /logs/ |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /installation/ |
| Disallow | /_foto/ |
| Disallow | /courses/ |
| Disallow | /online/ |
| Disallow | /online_kredit/ |
| Disallow | /credit/ |
| Disallow | /openads/ |
| Disallow | /openx/ |
| Disallow | /sxd/ |
| Disallow | /tablesort/ |
| Disallow | /templates/ |
| Disallow | /test/ |
| Disallow | /tmp/ |
| Disallow | /vendor/ |
| Disallow | /current/ |
| Disallow | /api/ |
| Allow | /css/ |
| Allow | /images/ |
| Allow | /js/ |
| Allow | /images/ |
| Allow | /includes/js/ |
| Allow | /templates/select_by7/scripts/ |
| Allow | /templates/select_by7/css/ |
| Allow | /mambots/content/stock/ |
| Allow | /components/com_news_portal/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://select.by/sitemap.xml |
| sitemap | https://select.by/sitemap.xml |
| sitemap | https://select.by/sitemap.xml |
Warnings
- `host` is not a known field.