ThorrJo@lemmy.sdf.org to LocalLLaMA@sh.itjust.worksEnglish · 3 months agoMicrosoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comexternal-linkmessage-square10fedilinkarrow-up143arrow-down11
arrow-up142arrow-down1external-linkMicrosoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comThorrJo@lemmy.sdf.org to LocalLLaMA@sh.itjust.worksEnglish · 3 months agomessage-square10fedilink
minus-squareweker01@sh.itjust.workslinkfedilinkEnglisharrow-up2·3 months agoFor a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.
For a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.