I’ve been following the work that went into this video for a couple of months and have grown to love Level1Techs.
Check out their forum and especially Ubergarm
You must log in or register to comment.
This is an excellent guide, way above most YT guides. ik_llama.cpp is a small miracle, and its a crime so few know of it.
Ok, what machine is it? DL;dw
Oh, so an NVIDIA card with 24GB VRAM
Yep, and 2x64gb RAM