• Candelestine@lemmy.world
    link
    fedilink
    English
    arrow-up
    32
    arrow-down
    1
    ·
    1 year ago

    … there’s no way their tech is good enough to avoid the billion and one ways to manipulate and confuse current-gen LLMs…

    Unless he went with older tech, just feeding specific pre-programmed responses to specific keywords. That’s a glorified phone tree though, nothing really new.

    • Sheltac@lemmy.world
      link
      fedilink
      English
      arrow-up
      17
      ·
      1 year ago

      There’s an in between. Have the LLM map into predefined responses, thus leveraging the LLM’s insane parsing abilities with the linearity of tree-like structures.

      It can be done, and can be done intelligently.

      Which I somewhat doubt was the case here.

      • lordcommander@waveform.social
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        At that point it’s probably cheaper to purchase support staff in SEA or Eastern Europe… staffing a software product team with ML and prompt engineers for a bespoke support solution is costly.

        Granted they probably went with a vendor, but that model has its own costly drawbacks.