netflow.by
robots.txt
Robots Exclusion Standard data for netflow.by
Resource Scan
Scan Details
| Site Domain | netflow.by |
| Base Domain | netflow.by |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-26T17:43:08+00:00 |
| Next Scan | 2025-09-25T17:43:08+00:00 |
Last Successful Scan
| Scanned | 2025-07-28T15:53:04+00:00 |
| URL | https://netflow.by/robots.txt |
| Domain IPs | 93.125.99.138 |
| Response IP | 93.125.99.138 |
| Found | Yes |
| Hash | 05f04475f9b37f55e448a717da67598500882daf9ae039ff7d3723a710cc5a59 |
| SimHash | 6b1e90f27a30 |
Groups
ahrefsbot
| Rule | Path |
|---|---|
| Allow | /service/ |
| Allow | /images/ |
| Allow | /prices/ |
| Allow | /blog/ |
| Allow | /forum/ |
| Allow | /contacts/ |
| Allow | /store |
| Allow | /about/ |
| Allow | /sitemap/ |
| Allow | /rabota/ |
| Allow | /home/it-humor/ |
| Allow | /home/article |
| Allow | /faqs |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/banners/ |
| Disallow | /images/sampledata/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /blog/itemlist/category |
| Disallow | /services-items |
| Disallow | /itemlist/user/ |
| Disallow | /news/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
semrushbot
| Rule | Path |
|---|---|
| Allow | /service/ |
| Allow | /images/ |
| Allow | /prices/ |
| Allow | /blog/ |
| Allow | /forum/ |
| Allow | /contacts/ |
| Allow | /store |
| Allow | /about/ |
| Allow | /sitemap/ |
| Allow | /rabota/ |
| Allow | /home/it-humor/ |
| Allow | /home/article |
| Allow | /faqs |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/banners/ |
| Disallow | /images/sampledata/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /blog/itemlist/category |
| Disallow | /services-items |
| Disallow | /itemlist/user/ |
| Disallow | /news/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
yandex
| Rule | Path |
|---|---|
| Allow | /service/ |
| Allow | /images/ |
| Allow | /prices/ |
| Allow | /blog/ |
| Allow | /forum/ |
| Allow | /contacts/ |
| Allow | /store |
| Allow | /about/ |
| Allow | /sitemap/ |
| Allow | /rabota/ |
| Allow | /home/it-humor/ |
| Allow | /home/article |
| Allow | /faqs |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/banners/ |
| Disallow | /images/sampledata/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /blog/itemlist/category |
| Disallow | /services-items |
| Disallow | /itemlist/user/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandexnews
| Rule | Path |
|---|---|
| Allow | /service/ |
| Allow | /images/ |
| Allow | /prices/ |
| Allow | /blog/ |
| Allow | /forum/ |
| Allow | /contacts/ |
| Allow | /store |
| Allow | /about/ |
| Allow | /sitemap/ |
| Allow | /rabota/ |
| Allow | /home/it-humor/ |
| Allow | /home/article |
| Allow | /faqs |
| Allow | /index.php?option=com_xmap&view=xml&id=1 |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/banners/ |
| Disallow | /images/sampledata/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /blog/itemlist/category |
| Disallow | /services-items |
| Disallow | /itemlist/user/ |
| Disallow | / |
| Disallow | /images/blog_images |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Allow | /service/ |
| Allow | /images/ |
| Allow | /prices/ |
| Allow | /blog/ |
| Allow | /forum/ |
| Allow | /contacts/ |
| Allow | /store |
| Allow | /about/ |
| Allow | /sitemap/ |
| Allow | /rabota/ |
| Allow | /home/it-humor/ |
| Allow | /home/article |
| Allow | /faqs |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/banners/ |
| Disallow | /images/sampledata/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /blog/itemlist/category |
| Disallow | /services-itemsDisallow%3A |
| Disallow | /itemlist/user/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://netflow.by/index.php?option=com_xmap&view=xml&id=1 |
| sitemap | https://netflow.by/index.php?option=com_xmap&view=xml&id=1 |
| sitemap | https://netflow.by/index.php?option=com_xmap&view=xml&id=1 |
| sitemap | https://netflow.by/index.php?option=com_xmap&view=xml&id=1 |
| sitemap | https://netflow.by/index.php?option=com_xmap&view=xml&id=1 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.