I think that in that case, YouTube is your friend. There are a few pretty straight forward videos that can help you out; if you’re serious about it you’re going have to, eventually, become familiar with it.
in that case you’re looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you’re limited to smaller models.
Booooooooooo!
Anyway: ill just keep using alpaca to run llms locally
is there an easy way to do this that doesn’t require me to understand how github works?
I think that in that case, YouTube is your friend. There are a few pretty straight forward videos that can help you out; if you’re serious about it you’re going have to, eventually, become familiar with it.
I recommend Ollama, its easy to setup and the cli can download and run llms. With some more techsavviness you can get openwebui as a nice ui.
https://ollama.com/ https://openwebui.com/
For someone who doesn’t understand GitHub, the CLI might be a bit much, FWIW.
It would be nice if there were a GUI, download-and-run single click app with a webui built in.
in that case you’re looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you’re limited to smaller models.
That sounds interesting, I’ll check it out, thanks!