fairspin-axx.sbs
robots.txt
Robots Exclusion Standard data for fairspin-axx.sbs
Resource Scan
Scan Details
| Site Domain | fairspin-axx.sbs |
| Base Domain | fairspin-axx.sbs |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-05-06T23:38:51+00:00 |
| Next Scan | 2024-06-05T23:38:51+00:00 |
Last Successful Scan
| Scanned | 2024-04-07T23:36:05+00:00 |
| URL | http://www.fairspin-axx.sbs/robots.txt |
| Redirect | https://www.sports.ru/robots.txt |
| Redirect Domain | www.sports.ru |
| Redirect Base | sports.ru |
| Domain IPs | 37.209.240.8 |
| Redirect IPs | 37.209.240.8 |
| Response IP | 37.209.240.8 |
| Found | Yes |
| Hash | 713f5a3abd68d6678869cfc5e3560a32edf2a3422c9a7b47e1051d18939d6a02 |
| SimHash | 6504c44e8a13 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /stat/export/android |
| Allow | /stat/export/iphone |
| Allow | /stat/export/cyber |
| Allow | /stat/export/rss |
| Disallow | /desktop/ |
| Disallow | /search/ |
| Disallow | /profile/restore_password.html |
| Disallow | /stat/export/ |
| Disallow | /api/ |
| Disallow | /ajax/ |
| Disallow | /*%26from_type |
| Disallow | /*?query |
| Disallow | /gb/ |
| Disallow | /feed/ |
| Disallow | /star-pages/* |
| Disallow | /components/* |
| Disallow | /core/ |
| Disallow | /betting-rating/* |
| Disallow | /ru.sports.apk |
yandex
| Rule | Path |
|---|---|
| Allow | /stat/export/android |
| Allow | /stat/export/iphone |
| Allow | /stat/export/cyber |
| Allow | /stat/export/rss |
| Disallow | /desktop/ |
| Disallow | /search/ |
| Disallow | /profile/restore_password.html |
| Disallow | /stat/export/ |
| Disallow | /api/ |
| Disallow | /ajax/ |
| Disallow | /*%26from_type |
| Disallow | /*?query |
| Disallow | /gb/ |
| Disallow | /feed/ |
| Disallow | /star-pages/* |
| Disallow | /components/* |
| Disallow | /amp/ |
| Disallow | /core/ |
| Disallow | /betting-rating/* |
| Disallow | /ru.sports.apk |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sports.ru/sitemap_index_online.xml |
| sitemap | https://www.sports.ru/sitemap_index_tags.xml |
| sitemap | https://www.sports.ru/sitemap_index_news.xml |
| sitemap | https://www.sports.ru/sitemap_index_articles.xml |
| sitemap | https://www.sports.ru/sitemap_index_blogs.xml |
| sitemap | https://www.sports.ru/sitemap_index_blogposts.xml |
| sitemap | https://www.sports.ru/sitemap_index_health.xml |
| sitemap | https://www.sports.ru/actual_sitemap_news.xml |
Warnings
- `clean-param` is not a known field.