motorsport.com
robots.txt
Robots Exclusion Standard data for motorsport.com
Resource Scan
Scan Details
Site Domain | motorsport.com |
Base Domain | motorsport.com |
Scan Status | Ok |
Last Scan | 2024-04-24T09:37:29+00:00 |
Next Scan | 2024-05-01T09:37:29+00:00 |
Last Scan
Scanned | 2024-04-24T09:37:29+00:00 |
URL | https://motorsport.com/robots.txt |
Redirect | https://www.motorsport.com/robots.txt |
Redirect Domain | www.motorsport.com |
Redirect Base | motorsport.com |
Domain IPs | 34.225.196.239, 54.147.216.182 |
Redirect IPs | 13.33.88.115, 13.33.88.116, 13.33.88.2, 13.33.88.75 |
Response IP | 13.33.88.75 |
Found | Yes |
Hash | c59fd15d1ee1b115400183de6c8448b5bebe70aa090d920ebb3e4ab3e552dd18 |
SimHash | 48388dc284b3 |
Groups
yandex
Rule | Path |
---|---|
Allow | /rss/yandex-zen/news/ |
Disallow | *?q= |
Disallow | */?filters |
Disallow | */videos/add-your-video/ |
Disallow | */photos/user-uploads-albums/ |
Disallow | */?edition= |
Disallow | /srv.php |
Disallow | /index.php |
Disallow | /disqus |
Allow | /f1/news/?q=giorgio%20piola |
Disallow | /driver/*/bio/ |
Disallow | /v/* |
Disallow | /lt/* |
Disallow | /dashboard/* |
Disallow | /search/* |
Allow | /*/photos/ |
Allow | /*/photos/* |
Disallow | /*/photos/*/* |
googlebot
Rule | Path |
---|---|
Disallow | *?q= |
Disallow | */?filters |
Disallow | */videos/add-your-video/ |
Disallow | */photos/user-uploads-albums/ |
Disallow | */?edition= |
Disallow | *?_openstat= |
Disallow | /thewall2 |
Disallow | /srv.php |
Disallow | /index.php |
Disallow | /disqus |
Allow | /f1/news/?q=giorgio%20piola |
Allow | /design/* |
Disallow | /driver/*/bio/ |
Disallow | /v/* |
Disallow | /lt/* |
Disallow | /dashboard/* |
Disallow | /search/* |
Disallow | /search/photos/* |
Disallow | */party-poker/get-odds/* |
Disallow | */first-article/* |
Disallow | */coral/* |
*
Rule | Path |
---|---|
Disallow | /videos/embed/ |
Disallow | /driver/*/bio/ |
Disallow | /v/* |
Disallow | /lt/* |
Disallow | /dashboard/* |
Disallow | /search/* |
Disallow | */party-poker/get-odds/* |
Disallow | */first-article/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.motorsport.com/sitemap.xml |
sitemap | https://www.motorsport.com/sitemap.xml |
Warnings
- `host` is not a known field.