Log In Sign Up

franklinproject.org
robots.txt

Robots Exclusion Standard data for franklinproject.org

Resource Scan

Scan Details

Site Domain franklinproject.org
Base Domain franklinproject.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-16T17:54:29+00:00
Next Scan 2026-02-14T17:54:29+00:00

Last Successful Scan

Scanned2025-01-21T16:22:43+00:00
URL https://franklinproject.org/robots.txt
Domain IPs 104.21.31.44, 172.67.174.245, 2606:4700:3031::6815:1f2c, 2606:4700:3036::ac43:aef5
Response IP 172.67.174.245
Found Yes
Hash e84cb8f0bb92d1bf315b46c1ec6b753fd83b30cd2e58e4eebbfa2fec92458419
SimHash 781859c1e802

Groups

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /?s=*

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://franklinproject.org/sitemap.xml
sitemap https://franklinproject.org/news-sitemap.xml
Back to top