mapumbaa@lemmy.zip to LocalLLaMA@sh.itjust.worksEnglish · 6 days agoHP Z2 Mini G1a Review: Running GPT-OSS 120B Without a Discrete GPUwww.storagereview.comexternal-linkmessage-square10fedilinkarrow-up114arrow-down10
arrow-up114arrow-down1external-linkHP Z2 Mini G1a Review: Running GPT-OSS 120B Without a Discrete GPUwww.storagereview.commapumbaa@lemmy.zip to LocalLLaMA@sh.itjust.worksEnglish · 6 days agomessage-square10fedilink
minus-squareDomi@lemmy.secnd.melinkfedilinkEnglisharrow-up3·5 days agoI ordered a Beelink GTR9 Pro which should hopefully arrive next month. Really excited to play around with it, the 24GB in my 7900 XTX just don’t cut it for local LLMs. There are a lot of benchmarks for the 395 processor here: https://kyuz0.github.io/amd-strix-halo-toolboxes/ They are leaving a lot of performance (and VRAM) on the table by doing this on Windows.
I ordered a Beelink GTR9 Pro which should hopefully arrive next month.
Really excited to play around with it, the 24GB in my 7900 XTX just don’t cut it for local LLMs.
There are a lot of benchmarks for the 395 processor here: https://kyuz0.github.io/amd-strix-halo-toolboxes/
They are leaving a lot of performance (and VRAM) on the table by doing this on Windows.