• VoterFrog@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    15 hours ago

    The generalized learning is usually just the first step. Coding LLMs typically go through more rounds of specialized learning afterwards in order to tune and focus it towards solving those types of problems. Then there’s RAG, MCP, and simulated reasoning which are technically not training methods but do further improve the relevance of the outputs. There’s a lot of ongoing work in this space still. We haven’t seen the standard even settle yet.

    • voodooattack@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      7 hours ago

      Yeah, but what I meant was: we took a wrong turn along the way, but now that it’s set in stone, sunk cost fallacy took over. We (as senior developers) are applying knowledge and approaches obtained through a trap we would absolutely caution and warn a junior against until the lesson sticks, because it IS a big deal.

      Reminds me of this gem:

      https://www.monkeyuser.com/2018/final-patch/