• fmstrat@lemmy.nowsci.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    7 hours ago

    Just remember, Ollama’s version of 8b models is not the same as the original on Huggingface. There’s a reason it’s a much smaller file size. That being said my understanding is the quant is good.