arborit.ai
robots.txt

Robots Exclusion Standard data for arborit.ai

Resource Scan

Scan Details

Site Domain arborit.ai
Base Domain arborit.ai
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-27T14:36:56+00:00
Next Scan 2025-10-25T14:36:56+00:00

Last Successful Scan

Scanned2025-04-05T06:39:44+00:00
URL https://arborit.ai/robots.txt
Domain IPs 13.33.88.127, 13.33.88.26, 13.33.88.28, 13.33.88.53
Response IP 13.33.88.53
Found Yes
Hash e24dd81b96b977a9a1a155f8389d1a9da59a8c67d55aa742c17ec0e7186857c8
SimHash 8908ca32c732

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/