

To me the value has come mostly from “ok, so it sounds to me you are saying that…” and the ability to confirm that I haven’t misunderstood something (of course with current LLMs both the original answer and the verification have to be taken with a heaping of salt). And the ability to adapt it on the go to a concrete example. So, kind of like a having a teacher or an expert friend, and not just search engine.
Like the last time I relied heavily on a LLM to help/teach me with something it was to explain the PC boot process and BIOS/UEFI to me, and how it applied step by step on how successfully deal with USB and bootloader issues on an “eccentric” HP laptop when installing Linux. The combination of explaining and doing and answering questions was way better than an encyclopedia. No doubt it could have been done with blog posts and textbooks, and I did have to make “educated guesses” on occasion, but all in all it was a great experience.
Device-wise, have you considered separating your project and personal computer? You could coreboot a small light Chromebook as a personal, ultraportable device, and get a hefty laptop or even a desktop for the hard stuff.
Chatwise, there’s Matrix, XMPP and SimpleX at least. And Briar and Session. But Signal with its phone number registration is the easiest for others to jump to.
And yes, it’s a constant balancing act between privacy and convenience… and the IA of the security triad, and open source principles. Just like with most things, there’s no perfect solution, you just learn to live with the least bad ones.