marathons.fr
robots.txt

Robots Exclusion Standard data for marathons.fr

Resource Scan

Scan Details

Site Domain marathons.fr
Base Domain marathons.fr
Scan Status Ok
Last Scan2026-03-30T09:17:32+00:00
Next Scan 2026-04-06T09:17:32+00:00

Last Scan

Scanned2026-03-30T09:17:32+00:00
URL https://marathons.fr/robots.txt
Redirect https://www.marathons.fr/robots.txt
Redirect Domain www.marathons.fr
Redirect Base marathons.fr
Domain IPs 2a01:238:20a:202:1172::, 81.169.145.172
Redirect IPs 2a01:238:20a:202:1172::, 81.169.145.172
Response IP 81.169.145.172
Found Yes
Hash 8c3fc05618974f9737080179fff70a9cc6b8b7a8ad18b9893fafd04ff7d09710
SimHash e147dc3ce391

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Allow /local/cache-gd2/
Allow /local/cache-vignettes/
Disallow /ecrire/
Disallow /prive/
Disallow /squelettes/
Disallow /squelettes-dist/
Disallow /plugins/
Disallow /plugins-dist/
Disallow /lib/
Disallow /local/
Disallow /tmp/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*
Disallow /*.api/
Disallow /*?debut_courses_avenir_france
Disallow /*?pagination_courses_avenir_france
Disallow /*?debut_courses_avenir_monde
Disallow /*?pagination_courses_avenir_monde
Disallow /*?debut_articles_lies
Disallow /*?pagination_articles_lies

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.marathons.fr/sitemap.xml