The hardware requirements are quite steep, but I’ve got local AI running in my house. It’s mostly just there for when I want to screw around with it, but technically I could setup OpenClaw and point it to my AI server to use as its brain.
I’m not stupid enough to do that on any real computer I use, but it might be cool to do on a VM where I can tightly control what it can see and have access to. Of course, that limits its usefulness, but security has a cost.
At the same time, I can see the allure of a real digital assistant. I’m old enough to remember when professionals had personal assistants that not only helped them keep track of their work life, but also their personal life. Scheduling their personal life like doctors appointments or house repairs. Dealing with vendors to make sure stuff actually gets done, and making sure they are in the right place at the right time. That would be rad to have.
I mean, I can run a few of the private AI stacks, but it is excruciatingly slow as to make it not worth the time. I would want something pretty responsive.
The “else-hosted” LLM AI is really not my thing, but selfhosted even less…
If I had the proper equipment, I’d run AI if it were self contained and not pinging out to another LLM.
@irmadlad @selfhosted That is precisely the challenge. I’m not sure it is possible.
The hardware requirements are quite steep, but I’ve got local AI running in my house. It’s mostly just there for when I want to screw around with it, but technically I could setup OpenClaw and point it to my AI server to use as its brain.
I’m not stupid enough to do that on any real computer I use, but it might be cool to do on a VM where I can tightly control what it can see and have access to. Of course, that limits its usefulness, but security has a cost.
At the same time, I can see the allure of a real digital assistant. I’m old enough to remember when professionals had personal assistants that not only helped them keep track of their work life, but also their personal life. Scheduling their personal life like doctors appointments or house repairs. Dealing with vendors to make sure stuff actually gets done, and making sure they are in the right place at the right time. That would be rad to have.
I mean, I can run a few of the private AI stacks, but it is excruciatingly slow as to make it not worth the time. I would want something pretty responsive.
@irmadlad This what I want too. It’s farther down my to-do list, but I’ll be sure to let you know if I discover anything. Good luck!
Ok. Yeah, if I’m going to create all my tentacle porn with AI, it should do so while I’m still in the mood. /s LOL