planetemotard.fr
robots.txt

Robots Exclusion Standard data for planetemotard.fr

Resource Scan

Scan Details

Site Domain planetemotard.fr
Base Domain planetemotard.fr
Scan Status Ok
Last Scan2025-11-20T16:11:41+00:00
Next Scan 2025-12-04T16:11:41+00:00

Last Scan

Scanned2025-11-20T16:11:41+00:00
URL https://planetemotard.fr/robots.txt
Redirect https://www.planetemotard.fr/robots.txt
Redirect Domain www.planetemotard.fr
Redirect Base planetemotard.fr
Domain IPs 108.60.73.49
Redirect IPs 108.60.73.49
Response IP 108.60.73.49
Found Yes
Hash 151d93fdb9152cc4bf44119d4ad04e976bad8be21ad35bf6f91814849f189606
SimHash 6c5cdc609e08

Groups

claudebot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /ad_link/
Disallow /in/
Disallow /upgrade/
Disallow /_core/
Disallow /layouts/files/
Disallow /files/
Disallow /c/
Disallow /rc_statement
Disallow /unsubscribe_email
Disallow /app_in
Disallow /invoice

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.planetemotard.fr/sitemap