ThorrJo@lemmy.sdf.org to LocalLLaMA@sh.itjust.worksEnglish · 9 days agoMicrosoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comexternal-linkmessage-square10fedilinkarrow-up140arrow-down11
arrow-up139arrow-down1external-linkMicrosoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comThorrJo@lemmy.sdf.org to LocalLLaMA@sh.itjust.worksEnglish · 9 days agomessage-square10fedilink
minus-squareweker01@sh.itjust.workslinkfedilinkEnglisharrow-up2·8 days agoFor a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.
For a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.