ru.motorsport.com
robots.txt
Robots Exclusion Standard data for ru.motorsport.com
Resource Scan
Scan Details
| Site Domain | ru.motorsport.com |
| Base Domain | motorsport.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-10T09:21:47+00:00 |
| Next Scan | 2024-05-17T09:21:47+00:00 |
Last Successful Scan
| Scanned | 2024-05-02T09:09:21+00:00 |
| URL | https://ru.motorsport.com/robots.txt |
| Redirect | https://www.motorsport.com:443/robots.txt |
| Redirect Domain | www.motorsport.com |
| Redirect Base | motorsport.com |
| Domain IPs | 18.210.228.113, 52.20.20.216 |
| Redirect IPs | 13.33.88.115, 13.33.88.116, 13.33.88.2, 13.33.88.75 |
| Response IP | 13.33.88.75 |
| Found | Yes |
| Hash | c59fd15d1ee1b115400183de6c8448b5bebe70aa090d920ebb3e4ab3e552dd18 |
| SimHash | 48388dc284b3 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /rss/yandex-zen/news/ |
| Disallow | *?q= |
| Disallow | */?filters |
| Disallow | */videos/add-your-video/ |
| Disallow | */photos/user-uploads-albums/ |
| Disallow | */?edition= |
| Disallow | /srv.php |
| Disallow | /index.php |
| Disallow | /disqus |
| Allow | /f1/news/?q=giorgio%20piola |
| Disallow | /driver/*/bio/ |
| Disallow | /v/* |
| Disallow | /lt/* |
| Disallow | /dashboard/* |
| Disallow | /search/* |
| Allow | /*/photos/ |
| Allow | /*/photos/* |
| Disallow | /*/photos/*/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | *?q= |
| Disallow | */?filters |
| Disallow | */videos/add-your-video/ |
| Disallow | */photos/user-uploads-albums/ |
| Disallow | */?edition= |
| Disallow | *?_openstat= |
| Disallow | /thewall2 |
| Disallow | /srv.php |
| Disallow | /index.php |
| Disallow | /disqus |
| Allow | /f1/news/?q=giorgio%20piola |
| Allow | /design/* |
| Disallow | /driver/*/bio/ |
| Disallow | /v/* |
| Disallow | /lt/* |
| Disallow | /dashboard/* |
| Disallow | /search/* |
| Disallow | /search/photos/* |
| Disallow | */party-poker/get-odds/* |
| Disallow | */first-article/* |
| Disallow | */coral/* |
*
| Rule | Path |
|---|---|
| Disallow | /videos/embed/ |
| Disallow | /driver/*/bio/ |
| Disallow | /v/* |
| Disallow | /lt/* |
| Disallow | /dashboard/* |
| Disallow | /search/* |
| Disallow | */party-poker/get-odds/* |
| Disallow | */first-article/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.motorsport.com/sitemap.xml |
| sitemap | https://www.motorsport.com/sitemap.xml |
Warnings
- `host` is not a known field.