yarn.crafter-app.com
robots.txt

Robots Exclusion Standard data for yarn.crafter-app.com

Resource Scan

Scan Details

Site Domain yarn.crafter-app.com
Base Domain crafter-app.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-04T19:06:48+00:00
Next Scan 2025-11-03T19:06:48+00:00

Last Successful Scan

Scanned2025-09-05T13:50:47+00:00
URL https://yarn.crafter-app.com/robots.txt
Domain IPs 134.209.41.141
Response IP 134.209.41.141
Found Yes
Hash ca22be4c5416c9883719ade0894f961716082567ca23faf811dc70ac1441be8c
SimHash 61549842f310

Groups

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /