sports.fr
robots.txt
Robots Exclusion Standard data for sports.fr
Resource Scan
Scan Details
Site Domain | sports.fr |
Base Domain | sports.fr |
Scan Status | Ok |
Last Scan | 2024-06-02T14:20:36+00:00 |
Next Scan | 2024-06-09T14:20:36+00:00 |
Last Scan
Scanned | 2024-06-02T14:20:36+00:00 |
URL | https://sports.fr/robots.txt |
Redirect | https://www.sports.fr/robots.txt |
Redirect Domain | www.sports.fr |
Redirect Base | sports.fr |
Domain IPs | 104.26.6.246, 104.26.7.246, 172.67.75.30, 2606:4700:20::681a:6f6, 2606:4700:20::681a:7f6, 2606:4700:20::ac43:4b1e |
Redirect IPs | 104.26.6.246, 104.26.7.246, 172.67.75.30, 2606:4700:20::681a:6f6, 2606:4700:20::681a:7f6, 2606:4700:20::ac43:4b1e |
Response IP | 172.67.75.30 |
Found | Yes |
Hash | 597e8ad04db71392e4387489485ae1ee6e3f9883a9bb36dfc9279bce16a933ee |
SimHash | 2902c0ca3c8b |
Groups
*
Rule | Path |
---|---|
Disallow | /*/xmlrpc.php |
Disallow | /wp-*.php |
Disallow | /*/trackback/ |
Disallow | /*?wptheme= |
Disallow | /*?comments= |
Disallow | /*?replytocom |
Disallow | /*/comment-page- |
Disallow | /*?s= |
Disallow | /*?*preview_id=* |
Disallow | /*/vote/favorite/form |
Disallow | /*?nowprocket=1&no_optimize=1 |
Disallow | /*?no_optimize=1 |
Disallow | /*?nowprocket=1 |
Disallow | |
Disallow | /*.swf |
Disallow | /*.doc |
Disallow | /wp-login.php |
Disallow | /wp-content/plugins/ |
Allow | /*/wp-content/themes/*/assets/ |
Allow | /*/wp-includes/js |
Allow | /*/wp-content/themes/**/*.css |
Allow | /*/wp-content/themes/**/*.js |
Allow | /*/wp-content/themes/**/*.gif |
Allow | /*/wp-content/plugins/**/*.css |
Allow | /*/wp-content/plugins/**/*.js |
Allow | /*/wp-content/plugins/**/*.gif |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://www.sports.fr/sitemap-news.xml |
sitemap | https://www.sports.fr/sitemap_index.xml |
Comments