And no i do not have the privilege of running a local model. I have heard of a AI called Maple and tried it out, it was pretty limited to the point that it was a deal breaker (25 messages per week cap). I would like to know more services
And no i do not have the privilege of running a local model. I have heard of a AI called Maple and tried it out, it was pretty limited to the point that it was a deal breaker (25 messages per week cap). I would like to know more services
I use Jan. It’s really good. A minimal install needs around 10GB of space and you can use it offline. The ‘jan nano’ model works faster than I can read in most cases.
The Qwen models that you can run with llama.cpp (Jan’s main backend) are quite brilliant for their size
There are a few AI models that are in this category, and I really liked Jan when I tested it out.
Cool, which ones do you recommend? Yeah, I found it really straightforward and pleasant to get started.