Log In Sign Up

therestartproject.org
robots.txt

Robots Exclusion Standard data for therestartproject.org

Resource Scan

Scan Details

Site Domain therestartproject.org
Base Domain therestartproject.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T13:51:07+00:00
Next Scan 2025-10-10T13:51:07+00:00

Last Successful Scan

Scanned2025-08-19T12:35:36+00:00
URL https://therestartproject.org/robots.txt
Domain IPs 104.21.40.148, 172.67.153.13
Response IP 172.67.153.13
Found Yes
Hash 9a47a3a8019dd33bc1faa95fdab09af6081748e96e5b147d0b7ddee0d8462bb1
SimHash f41d59508080

Groups

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /
Back to top