Rendered at 01:32:01 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
car 2 hours ago [-]
This looks and works great, super impressed. This is what Siri/Apple AI should be like.
One concern I have is about sending private info to Anthropic. So it would be great to have the option to use local AI.
Local options should support the OpenAI API that seemingly is the standard for these connections, as provided by Llama.app and Unsloth Studio for example. That way one could run against a local model and keep personal information private.
That of course begs the question if a local model is smart enough for the tasks at hand.
I'm also trying out OOMU, a similar but closed source personal assistant app for MacOS. It emphasizes privacy with local models, and even has an 'Airplane' mode. The app has a built in llama.cpp server and uses Gemma-4-4B, their own router model plus a vision model.
SaarthRanka 1 hours ago [-]
Thank you so much!
Most daily commands like launching and moving around sites/apps happen without AI, but I agree with the privacy concern and will definitely look into utilizing local AI.
Smaller models, like Haiku, I have found to already struggle during multi-step tasks, so I expect local model capabilities to reduce performance further.
I'll look into how OOMU splits their work up, but what local model would you suggest starting with?
blakeashleyjr 9 hours ago [-]
I have been looking for this kind of thing on Linux. Any one have anything that works well?
Awesome! I'll be sure to link your fork in my readme. I'm curious what problems arose when you ported it?
imranshah10140 17 hours ago [-]
Will this work on the Windows as well or just for mac users. by the way really like it from what I can see it from the demo video. If it works as it shown and also I dont thinks so that it is for windows would love if you can clear this out.
FindlayH 16 hours ago [-]
I liked the idea and forked the original, for is only proven to work on my local but can be run by others, also build out integrations so I can have it work with common homelab services and MCPs
One concern I have is about sending private info to Anthropic. So it would be great to have the option to use local AI.
Local options should support the OpenAI API that seemingly is the standard for these connections, as provided by Llama.app and Unsloth Studio for example. That way one could run against a local model and keep personal information private.
That of course begs the question if a local model is smart enough for the tasks at hand.
I'm also trying out OOMU, a similar but closed source personal assistant app for MacOS. It emphasizes privacy with local models, and even has an 'Airplane' mode. The app has a built in llama.cpp server and uses Gemma-4-4B, their own router model plus a vision model.
Most daily commands like launching and moving around sites/apps happen without AI, but I agree with the privacy concern and will definitely look into utilizing local AI.
Smaller models, like Haiku, I have found to already struggle during multi-step tasks, so I expect local model capabilities to reduce performance further.
I'll look into how OOMU splits their work up, but what local model would you suggest starting with?
https://github.com/FindlayHi/atticus-windows